Jun 23 20:05:38 devstack cinder-volume[82690]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 20:05:38 devstack cinder-volume[82690]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 20:05:38 devstack cinder-volume[82690]: we strongly recommend against using it for new projects. Jun 23 20:05:38 devstack cinder-volume[82690]: If you are already using Eventlet, we recommend migrating to a different Jun 23 20:05:38 devstack cinder-volume[82690]: framework. For more detail see Jun 23 20:05:38 devstack cinder-volume[82690]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 20:05:38 devstack cinder-volume[82690]: import eventlet # noqa Jun 23 20:05:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 20:05:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 20:05:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 20:05:41 devstack cinder-volume[82690]: INFO dbcounter [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Registered counter for database cinder Jun 23 20:05:41 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:05:41 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writer thread running {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 20:05:41 devstack cinder-volume[82690]: INFO cinder.rpc [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 20:05:41 devstack cinder-volume[82690]: INFO cinder.rpc [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:05:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Determined volume DB was empty at startup. Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82690) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 20:05:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 20:05:42 devstack cinder-volume[82690]: WARNING stevedore.named [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 20:05:42 devstack cinder-volume[82690]: WARNING castellan.key_manager [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 20:05:42 devstack cinder-volume[82690]: WARNING cinder.keymgr.conf_key_mgr [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.lvm [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82690) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] CMD "cinder-rtstool verify" returned: 0 in 0.407s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:05:42 devstack cinder-volume[82690]: INFO cinder.rpc [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 23 20:05:42 devstack cinder-volume[82690]: INFO cinder.rpc [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 23 20:05:42 devstack cinder-volume[82690]: WARNING stevedore.named [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 20:05:42 devstack cinder-volume[82690]: WARNING castellan.key_manager [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 20:05:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:05:42 devstack cinder-volume[82690]: INFO oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Starting 1 workers Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Started child 82842 {{(pid=82690) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Full set of CONF: {{(pid=82690) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] ******************************************************************************** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Configuration options gathered from: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] ================================================================================ {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] allow_availability_zone_fallback = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] allow_compression_on_image_upload = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] allowed_direct_url_schemes = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] api_rate_limit = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] auth_strategy = keystone {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] az_cache_duration = 3600 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_availability_zone = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_host = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_stats_polling_interval = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backup_api_class = cinder.backup.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backup_name_template = backup-%s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backup_use_same_host = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backup_use_temp_snapshot = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] chap_password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] chap_username = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_internal_tenant_project_id = 867bfc20ea91484d949d6afa4d414b3d {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_internal_tenant_user_id = 35c4e07b20c54a77b45d9a9f52aad010 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cloned_volume_same_az = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cluster = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] compression_format = gzip {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82842]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] compute_api_class = cinder.compute.nova.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] config_dir = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] config_source = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] control_exchange = openstack {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] debug = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] default_availability_zone = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] default_group_type = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] default_volume_type = lvmdriver-1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] disk_geometry = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] driver_client_cert = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] driver_client_cert_key = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] driver_data_namespace = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] driver_ssl_cert_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] driver_ssl_cert_verify = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] driver_use_ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] enable_force_upload = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] enable_new_services = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] enable_unsupported_driver = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] enabled_backends = ['lvmdriver-1'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] enforce_multipath_for_image_xfer = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] filter_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_api_insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_api_ssl_compression = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_ca_certificates_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_catalog_info = image:glance:publicURL {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_num_retries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance_request_timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] goodness_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] graceful_shutdown_timeout = 5 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] group_api_class = cinder.group.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] host = devstack {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_compress_on_upload = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_conversion_address_space_limit = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_conversion_cpu_limit = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_conversion_disable = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_upload_use_cinder_backend = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_upload_use_internal_tenant = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_volume_cache_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_volume_cache_max_count = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] image_volume_cache_max_size_gb = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] init_host_max_objects_retrieval = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] instance_format = [instance: %(uuid)s] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] iscsi_target_flags = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] iscsi_write_cache = on {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] iser_helper = tgtadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] iser_ip_address = 192.168.122.163 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] iser_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_color = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_config_append = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_dir = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_options = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_rotate_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_rotate_interval_type = days {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] log_rotation_type = none {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] max_age = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] max_logfile_count = 30 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] max_logfile_size_mb = 200 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] max_over_subscription_ratio = 20.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] message_reap_interval = 86400 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] message_ttl = 2592000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] migration_create_volume_timeout_secs = 300 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] monkey_patch = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] monkey_patch_modules = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] my_ip = 192.168.122.163 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] no_snapshot_gb_quota = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] num_iser_scan_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] num_shell_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] num_volume_device_scan_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] nvmeof_conn_info_version = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] nvmet_ns_id = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] nvmet_port_id = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] osapi_max_limit = 1000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] osapi_volume_ext_list = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] osapi_volume_listen = 0.0.0.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] osapi_volume_listen_port = 8776 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] osapi_volume_use_ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] osapi_volume_workers = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] per_volume_size_limit = -1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] periodic_fuzzy_delay = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] periodic_interval = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] project_id_regex = [0-9a-f\-]+ {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] public_endpoint = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] publish_errors = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] quota_backup_gigabytes = 1000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] quota_backups = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] quota_gigabytes = 1000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] quota_groups = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] quota_snapshots = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] quota_volumes = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] rate_limit_burst = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] rate_limit_except_level = CRITICAL {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] rate_limit_interval = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] reinit_driver_count = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] replication_device = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] report_discard_supported = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] report_interval = 120 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] reservation_clean_interval = 86400 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] reservation_expire = 86400 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] reserved_image_namespaces = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] reserved_percentage = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] rpc_response_timeout = 120 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] run_external_periodic_tasks = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] scst_target_driver = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] scst_target_iqn_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_down_time = 720 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] shell_completion = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] snapshot_name_template = snapshot-%s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] snapshot_same_host = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] state_path = /opt/stack/data/cinder {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] storage_availability_zone = nova {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] storage_protocol = iSCSI {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] syslog_log_facility = LOG_USER {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] target_helper = lioadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] target_ip_address = 192.168.122.163 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] target_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] target_protocol = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] target_secondary_ip_addresses = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] trace_flags = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] transfer_api_class = cinder.transfer.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] transport_url = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] until_refresh = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] use_chap_auth = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] use_default_quota_class = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] use_journal = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] use_json = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] use_multipath_for_image_xfer = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] use_stderr = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] use_syslog = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] verify_glance_signatures = enabled {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_api_class = cinder.volume.api.API {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_backend_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_clear = zero {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_clear_ionice = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_clear_size = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_copy_bps_limit = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_dd_blocksize = 1M {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_name_template = volume-%s {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_service_inithost_offload = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volume_usage_audit_period = month {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] zoning_mode = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_concurrency.disable_process_locking = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.auth_section = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.auth_type = password {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.auth_version = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.cache = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.delay_auth_decision = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.http_connect_timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.include_service_catalog = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.interface = public {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_password = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcache_username = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.region_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.service_token_roles_required = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.service_type = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.token_cache_time = 300 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.backend = dogpile.cache.null {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.backend_argument = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.backend_expiration_time = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.config_prefix = cache.oslo {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.debug_cache_backend = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.enable_retry_client = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.enable_socket_keepalive = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.expiration_time = 600 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.hashclient_retry_attempts = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.memcache_dead_retry = 300 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.memcache_pool_maxsize = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.memcache_sasl_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.proxies = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.redis_db = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.redis_sentinel_service_name = mymaster {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.redis_server = localhost:6379 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.retry_attempts = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.retry_delay = 0.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.socket_keepalive_count = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.socket_keepalive_idle = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82842]: INFO cinder.volume.manager [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.socket_keepalive_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.socket_timeout = 1.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.tls_allowed_ciphers = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.tls_cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.tls_certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.tls_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.tls_keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cache.username = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] coordination.backend_url = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.asyncio_connection = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.asyncio_slave_connection = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.backend = sqlalchemy {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.connection = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.connection_debug = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.connection_parameters = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.connection_recycle_time = 3600 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.connection_trace = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.db_inc_retry_interval = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.db_max_retries = 20 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.db_max_retry_interval = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.db_retry_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.max_overflow = 50 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.max_pool_size = 5 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.max_retries = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.mysql_wsrep_sync_wait = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.pool_timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.retry_interval = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.slave_connection = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.sqlite_synchronous = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.synchronous_reader = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] database.use_db_reconnect = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.connection_string = messaging:// {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.es_doc_type = notification {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.es_scroll_size = 10000 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.es_scroll_time = 2m {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.filter_error_trace = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.hmac_keys = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.sentinel_service_name = mymaster {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.socket_timeout = 0.1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.trace_requests = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler.trace_sqlalchemy = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler_jaeger.process_tags = {} {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler_jaeger.service_name_prefix = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] profiler_otlp.service_name_prefix = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.enforce_new_defaults = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: WARNING oslo_config.cfg [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.enforce_scope = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.policy_default_rule = default {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.policy_file = policy.yaml {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_policy.remote_timeout = 60.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] privsep_osbrick.group = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] privsep_osbrick.helper_command = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] privsep_osbrick.user = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_sys_admin.group = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_sys_admin.helper_command = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] cinder_sys_admin.user = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.auth_section = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.auth_type = password {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.collect_timing = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.send_service_user_token = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] service_user.timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.auth_section = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.auth_type = password {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.collect_timing = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.region_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] glance.timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.backend_availability_zone = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.chap_password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.chap_username = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.disk_geometry = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.driver_client_cert = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.driver_client_cert_key = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.driver_data_namespace = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.driver_use_ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.enable_unsupported_driver = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.extra_capabilities = {} {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.filter_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.goodness_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.iscsi_target_flags = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.iscsi_write_cache = on {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.iser_helper = tgtadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.iser_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.lvm_mirrors = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.lvm_share_target = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.lvm_type = auto {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.num_shell_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.nvmet_port_id = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.replication_device = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.report_discard_supported = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.reserved_percentage = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.scst_target_driver = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.scst_target_iqn_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.storage_protocol = iSCSI {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.target_helper = tgtadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.target_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.target_protocol = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.trace_flags = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.unique_fqdn_network = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.use_chap_auth = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_backend_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_clear = zero {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_clear_ionice = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_clear_size = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volume_group = cinder-volumes {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_reports.file_event_handler = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_reports.log_dir = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.backend_availability_zone = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.backend_host = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.chap_password = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.chap_username = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.chiscsi_conf = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.disk_geometry = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.driver_client_cert = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.driver_data_namespace = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.driver_use_ssl = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.extra_capabilities = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.filter_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.goodness_function = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.iser_helper = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.iser_ip_address = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.iser_port = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.iser_target_prefix = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:42 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.lvm_conf_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.lvm_mirrors = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.lvm_share_target = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.lvm_type = auto {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.num_shell_tries = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.nvmet_port_id = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.replication_device = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.report_discard_supported = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.reserved_percentage = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.scst_target_driver = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.storage_protocol = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.target_helper = lioadm {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.target_ip_address = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.target_port = 3260 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.target_protocol = iscsi {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.trace_flags = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.use_chap_auth = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_clear = zero {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_clear_size = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] lvmdriver-1.volumes_dir = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:42 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.ssl_version = {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_notifications.driver = [] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_notifications.retry = -1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] oslo_messaging_notifications.transport_url = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] key_manager.fixed_key = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.barbican_api_version = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.barbican_endpoint = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.barbican_endpoint_type = public {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.barbican_region_name = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.collect_timing = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.number_of_retries = 60 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.retry_delay = 1 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.send_service_user_token = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.verify_ssl = True {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican.verify_ssl_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.auth_section = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.auth_type = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.cafile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.certfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.collect_timing = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.insecure = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.keyfile = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.split_loggers = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] barbican_service_user.timeout = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.approle_role_id = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.approle_secret_id = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.kv_mountpoint = secret {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.kv_path = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.kv_version = 2 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.namespace = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.root_token_id = **** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.ssl_ca_crt_file = None {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.timeout = 60.0 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.use_ssl = False {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:05:42 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] ******************************************************************************** {{(pid=82690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 20:05:42 devstack sudo[82847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 23 20:05:42 devstack sudo[82847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:43 devstack sudo[82847]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:43 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:43 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:43 devstack sudo[82949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:43 devstack sudo[82949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:44 devstack sudo[82949]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:44 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.682s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:44 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:05:44 devstack cinder-volume[82842]: INFO cinder.brick.local_dev.lvm [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 23 20:05:44 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:44 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:44 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:44 devstack sudo[83209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:05:44 devstack sudo[83209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:45 devstack sudo[83209]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:45 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:45 devstack cinder-volume[82842]: DEBUG cinder.brick.local_dev.lvm [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82842) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 23 20:05:45 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:45 devstack sudo[83414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:45 devstack sudo[83414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:46 devstack sudo[83414]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:46 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.132s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:46 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:46 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:46 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:46 devstack sudo[83622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:46 devstack sudo[83622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:46 devstack sudo[83622]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:46 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:46 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:46 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:46 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:46 devstack sudo[83627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 23 20:05:46 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:47 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:47 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.700s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:47 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:47 devstack sudo[83631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:05:47 devstack sudo[83631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:48 devstack sudo[83631]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:48 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.917s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:48 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:48 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:05:48 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:49 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:49 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.842s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:49 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:49 devstack sudo[83653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:05:49 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:50 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:50 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:50 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:50 devstack sudo[83662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:50 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:50 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:50 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:50 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:50 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:50 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:50 devstack sudo[83667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:50 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:51 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:51 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.863s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:51 devstack cinder-volume[82842]: INFO cinder.volume.drivers.lvm [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 23 20:05:51 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:51 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:51 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:51 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:51 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:52 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:52 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.722s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:52 devstack cinder-volume[82842]: DEBUG cinder.volume.drivers.lvm [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Updating volume stats {{(pid=82842) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 20:05:52 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:52 devstack sudo[83868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:05:52 devstack sudo[83868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:52 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:05:53 devstack sudo[83868]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:53 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:53 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:53 devstack sudo[83936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:05:53 devstack sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:53 devstack sudo[83936]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:53 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:53 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:53 devstack sudo[83940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:53 devstack sudo[83940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:54 devstack sudo[83940]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:54 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:54 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:54 devstack sudo[83943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:05:54 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:54 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:54 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:54 devstack cinder-volume[82842]: INFO cinder.volume.driver [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 20:05:54 devstack cinder-volume[82842]: DEBUG cinder.volume.driver [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82842) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 20:05:55 devstack cinder-volume[82842]: DEBUG oslo_db.sqlalchemy.engines [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82842) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:05:55 devstack cinder-volume[82842]: DEBUG dbcounter [-] [82842] Writer thread running {{(pid=82842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 20:05:55 devstack cinder-volume[82842]: DEBUG cinder.db.api [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Building query based on filter {{(pid=82842) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 20:05:55 devstack cinder-volume[82842]: DEBUG cinder.image.image_utils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82842) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 20:05:55 devstack cinder-volume[82842]: INFO cinder.keymgr.migration [None req-9be0eacf-a122-44e8-accc-f3602416dac4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 20:05:55 devstack cinder-volume[82842]: DEBUG cinder.volume.drivers.lvm [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Updating volume stats {{(pid=82842) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 20:05:55 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:55 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:05:55 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:55 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:55 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:55 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:55 devstack sudo[83952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:05:55 devstack sudo[83952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:56 devstack sudo[83952]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:56 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:56 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:56 devstack sudo[83958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:56 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:57 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:57 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:57 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:57 devstack sudo[83962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:05:57 devstack sudo[83962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:57 devstack sudo[83962]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:57 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:57 devstack cinder-volume[82842]: DEBUG cinder.manager [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Notifying Schedulers of capabilities ... {{(pid=82842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:05:57 devstack cinder-volume[82842]: INFO cinder.volume.manager [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Driver initialization completed successfully. Jun 23 20:05:57 devstack cinder-volume[82842]: INFO cinder.manager [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Initiating service 2 cleanup Jun 23 20:05:57 devstack cinder-volume[82842]: INFO cinder.manager [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Service 2 cleanup completed. Jun 23 20:05:57 devstack cinder-volume[82842]: DEBUG cinder.service [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Creating RPC server for service cinder-volume {{(pid=82842) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 20:05:57 devstack cinder-volume[82842]: DEBUG cinder.service [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82842) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 20:05:58 devstack cinder-volume[82842]: INFO cinder.volume.manager [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 23 20:05:58 devstack cinder-volume[82842]: DEBUG cinder.volume.drivers.lvm [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Updating volume stats {{(pid=82842) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 20:05:58 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:58 devstack sudo[83966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:05:58 devstack sudo[83966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:58 devstack sudo[83966]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:58 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:58 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:58 devstack sudo[83969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:05:58 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:59 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:59 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:59 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:59 devstack sudo[84026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:05:59 devstack sudo[84026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:05:59 devstack sudo[84026]: pam_unix(sudo:session): session closed for user root Jun 23 20:05:59 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:05:59 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:05:59 devstack sudo[84032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:05:59 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:06:00 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root Jun 23 20:06:00 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:06:00 devstack cinder-volume[82842]: INFO cinder.volume.manager [None req-82c05957-0aa0-4498-b89c-058f068b3cc2 None None] Driver post RPC initialization completed successfully. Jun 23 20:06:02 devstack cinder-volume[82842]: DEBUG oslo_service.periodic_task [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running periodic task VolumeManager._thread_info {{(pid=82842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:06:02 devstack cinder-volume[82842]: DEBUG cinder.volume.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] thread count: 6 {{(pid=82842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:06:02 devstack cinder-volume[82842]: DEBUG cinder.volume.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] thread info: [<_MainThread(MainThread, started 133581018714240)>, , , , , ] {{(pid=82842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:06:10 devstack cinder-volume[82842]: DEBUG dbcounter [-] [82842] Writing DB stats cinder:SELECT=4 {{(pid=82842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:06:10 devstack cinder-volume[82842]: DEBUG dbcounter [-] [82842] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:07:02 devstack cinder-volume[82842]: DEBUG oslo_service.periodic_task [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:07:02 devstack cinder-volume[82842]: DEBUG cinder.volume.drivers.lvm [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Updating volume stats {{(pid=82842) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 20:07:02 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:07:02 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:07:02 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:07:03 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Jun 23 20:07:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:07:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:07:03 devstack sudo[85787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:07:03 devstack sudo[85787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:07:03 devstack sudo[85787]: pam_unix(sudo:session): session closed for user root Jun 23 20:07:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:07:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:07:03 devstack sudo[85790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:07:03 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:07:04 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root Jun 23 20:07:04 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:07:04 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:07:04 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:07:04 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:07:05 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Jun 23 20:07:05 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:07:05 devstack cinder-volume[82842]: DEBUG cinder.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Notifying Schedulers of capabilities ... {{(pid=82842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:07:05 devstack cinder-volume[82842]: DEBUG oslo_service.periodic_task [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running periodic task VolumeManager._thread_info {{(pid=82842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:07:05 devstack cinder-volume[82842]: DEBUG cinder.volume.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] thread count: 6 {{(pid=82842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:07:05 devstack cinder-volume[82842]: DEBUG cinder.volume.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] thread info: [<_MainThread(MainThread, started 133581018714240)>, , , , , ] {{(pid=82842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:08:02 devstack cinder-volume[82842]: DEBUG oslo_service.periodic_task [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:08:02 devstack cinder-volume[82842]: DEBUG cinder.volume.drivers.lvm [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Updating volume stats {{(pid=82842) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 20:08:02 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:08:02 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:08:02 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:08:03 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Jun 23 20:08:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:08:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:08:03 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:08:03 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:08:03 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Jun 23 20:08:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:08:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:08:03 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:08:03 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:08:04 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Jun 23 20:08:04 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:08:04 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:08:04 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:08:04 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:08:05 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Jun 23 20:08:05 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:08:05 devstack cinder-volume[82842]: DEBUG cinder.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Notifying Schedulers of capabilities ... {{(pid=82842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:08:05 devstack cinder-volume[82842]: DEBUG oslo_service.periodic_task [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running periodic task VolumeManager._thread_info {{(pid=82842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:08:05 devstack cinder-volume[82842]: DEBUG cinder.volume.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] thread count: 6 {{(pid=82842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:08:05 devstack cinder-volume[82842]: DEBUG cinder.volume.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] thread info: [<_MainThread(MainThread, started 133581018714240)>, , , , , ] {{(pid=82842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:08:10 devstack cinder-volume[82842]: DEBUG dbcounter [-] [82842] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:09:02 devstack cinder-volume[82842]: DEBUG oslo_service.periodic_task [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:09:02 devstack cinder-volume[82842]: DEBUG cinder.volume.drivers.lvm [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Updating volume stats {{(pid=82842) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 20:09:02 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:09:02 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:09:02 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:09:03 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Jun 23 20:09:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:09:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:09:03 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:09:03 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:09:03 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Jun 23 20:09:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:09:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:09:03 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:09:03 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:09:04 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Jun 23 20:09:04 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:09:04 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:09:04 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:09:04 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:09:05 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Jun 23 20:09:05 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:09:05 devstack cinder-volume[82842]: DEBUG cinder.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Notifying Schedulers of capabilities ... {{(pid=82842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:10:02 devstack cinder-volume[82842]: DEBUG oslo_service.periodic_task [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:10:02 devstack cinder-volume[82842]: DEBUG cinder.volume.drivers.lvm [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Updating volume stats {{(pid=82842) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 20:10:02 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:02 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 20:10:02 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:03 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:03 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:10:03 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:03 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:03 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:03 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 20:10:03 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:04 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:04 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:04 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:04 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 20:10:04 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:05 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:05 devstack cinder-volume[82842]: DEBUG oslo_concurrency.processutils [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:05 devstack cinder-volume[82842]: DEBUG cinder.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Notifying Schedulers of capabilities ... {{(pid=82842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:10:05 devstack cinder-volume[82842]: DEBUG oslo_service.periodic_task [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] Running periodic task VolumeManager._thread_info {{(pid=82842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:10:05 devstack cinder-volume[82842]: DEBUG cinder.volume.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] thread count: 6 {{(pid=82842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:10:05 devstack cinder-volume[82842]: DEBUG cinder.volume.manager [None req-0084f9f8-c76b-4d15-88de-601bb1771090 None None] thread info: [<_MainThread(MainThread, started 133581018714240)>, , , , , ] {{(pid=82842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:10:10 devstack cinder-volume[82842]: DEBUG dbcounter [-] [82842] Writing DB stats cinder:SELECT=1 {{(pid=82842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:10:10 devstack cinder-volume[82842]: DEBUG dbcounter [-] [82842] Writing DB stats cinder:UPDATE=1 {{(pid=82842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:10:43 devstack cinder-volume[82690]: INFO oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Caught SIGTERM, stopping children Jun 23 20:10:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Acquiring lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 20:10:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Acquired lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 20:10:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Releasing lock "singleton_lock" {{(pid=82690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 20:10:43 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Stop services. {{(pid=82690) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 20:10:43 devstack cinder-volume[82690]: DEBUG oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Killing children. {{(pid=82690) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 20:10:43 devstack cinder-volume[82690]: INFO oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Waiting on 1 children to exit Jun 23 20:10:47 devstack cinder-volume[82842]: DEBUG oslo_concurrency.lockutils [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Acquiring lock "singleton_lock" {{(pid=82842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 20:10:47 devstack cinder-volume[82842]: DEBUG oslo_concurrency.lockutils [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Acquired lock "singleton_lock" {{(pid=82842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 20:10:47 devstack cinder-volume[82842]: DEBUG oslo_concurrency.lockutils [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Releasing lock "singleton_lock" {{(pid=82842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 20:10:47 devstack cinder-volume[82842]: WARNING amqp [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 20:10:48 devstack cinder-volume[82842]: WARNING amqp [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 20:10:48 devstack cinder-volume[82690]: INFO oslo_service.backend._eventlet.service [None req-61e516fd-7f6e-4b96-bcea-880401a3dcce None None] Child 82842 exited with status 0 Jun 23 20:10:48 devstack cinder-volume[92937]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 20:10:48 devstack cinder-volume[92937]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 20:10:48 devstack cinder-volume[92937]: we strongly recommend against using it for new projects. Jun 23 20:10:48 devstack cinder-volume[92937]: If you are already using Eventlet, we recommend migrating to a different Jun 23 20:10:48 devstack cinder-volume[92937]: framework. For more detail see Jun 23 20:10:48 devstack cinder-volume[92937]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 20:10:48 devstack cinder-volume[92937]: import eventlet # noqa Jun 23 20:10:50 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 20:10:50 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 20:10:50 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 20:10:51 devstack cinder-volume[92937]: INFO dbcounter [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Registered counter for database cinder Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_db.sqlalchemy.engines [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG dbcounter [-] [92937] Writer thread running {{(pid=92937) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 20:10:51 devstack cinder-volume[92937]: INFO cinder.rpc [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 20:10:51 devstack cinder-volume[92937]: INFO cinder.rpc [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_db.sqlalchemy.engines [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:10:51 devstack cinder-volume[92937]: INFO cinder.volume.manager [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Determined volume DB was empty at startup. Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG cinder.volume.manager [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92937) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 20:10:51 devstack cinder-volume[92937]: INFO cinder.volume.manager [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 20:10:51 devstack cinder-volume[92937]: WARNING stevedore.named [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 20:10:51 devstack cinder-volume[92937]: WARNING castellan.key_manager [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 20:10:51 devstack cinder-volume[92937]: WARNING cinder.keymgr.conf_key_mgr [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 20:10:51 devstack cinder-volume[92937]: INFO cinder.volume.manager [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_db.sqlalchemy.engines [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:10:51 devstack cinder-volume[92937]: INFO oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Starting 1 workers Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Started child 93161 {{(pid=92937) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Full set of CONF: {{(pid=92937) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] ******************************************************************************** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Configuration options gathered from: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] ================================================================================ {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] allow_availability_zone_fallback = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] allow_compression_on_image_upload = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] allowed_direct_url_schemes = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] api_rate_limit = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] auth_strategy = keystone {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_availability_zone = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_host = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_stats_polling_interval = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backup_api_class = cinder.backup.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backup_name_template = backup-%s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backup_use_same_host = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backup_use_temp_snapshot = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] chap_password = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] chap_username = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_internal_tenant_project_id = 867bfc20ea91484d949d6afa4d414b3d {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[93161]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_internal_tenant_user_id = 35c4e07b20c54a77b45d9a9f52aad010 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cluster = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] compression_format = gzip {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] compute_api_class = cinder.compute.nova.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] config_dir = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] config_source = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] control_exchange = openstack {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] debug = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] default_availability_zone = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] default_group_type = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] default_volume_type = QuobyteHD {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] disk_geometry = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] driver_client_cert = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:51 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] driver_client_cert_key = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] driver_data_namespace = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] driver_ssl_cert_path = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] driver_ssl_cert_verify = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] driver_use_ssl = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] enable_new_services = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] enable_unsupported_driver = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] enabled_backends = ['QuobyteHD'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] enforce_multipath_for_image_xfer = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] filter_function = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_api_insecure = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_api_ssl_compression = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_ca_certificates_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_catalog_info = image:glance:publicURL {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_num_retries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance_request_timeout = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] goodness_function = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] graceful_shutdown_timeout = 5 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] group_api_class = cinder.group.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] host = devstack {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_compress_on_upload = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_conversion_address_space_limit = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_conversion_cpu_limit = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_conversion_disable = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_upload_use_cinder_backend = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_upload_use_internal_tenant = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_volume_cache_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_volume_cache_max_count = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] image_volume_cache_max_size_gb = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] init_host_max_objects_retrieval = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] instance_format = [instance: %(uuid)s] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] iscsi_target_flags = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] iscsi_write_cache = on {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] iser_helper = tgtadm {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] iser_ip_address = 192.168.122.163 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] iser_port = 3260 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_color = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_config_append = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_dir = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_options = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_rotate_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_rotate_interval_type = days {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] log_rotation_type = none {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] max_age = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] max_logfile_count = 30 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] max_logfile_size_mb = 200 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] max_over_subscription_ratio = 20.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] message_reap_interval = 86400 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] message_ttl = 2592000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] migration_create_volume_timeout_secs = 300 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] monkey_patch = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] monkey_patch_modules = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] my_ip = 192.168.122.163 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] no_snapshot_gb_quota = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] num_iser_scan_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] num_shell_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] num_volume_device_scan_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] nvmeof_conn_info_version = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] nvmet_ns_id = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] nvmet_port_id = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] osapi_max_limit = 1000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] osapi_volume_ext_list = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] osapi_volume_listen_port = 8776 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] osapi_volume_use_ssl = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] osapi_volume_workers = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] per_volume_size_limit = -1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] periodic_fuzzy_delay = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] periodic_interval = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] public_endpoint = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] publish_errors = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] quota_backup_gigabytes = 1000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] quota_backups = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] quota_gigabytes = 1000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] quota_groups = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] quota_snapshots = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] quota_volumes = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] rate_limit_burst = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] rate_limit_except_level = CRITICAL {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] rate_limit_interval = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] reinit_driver_count = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] replication_device = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] report_discard_supported = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] report_interval = 120 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] reservation_clean_interval = 86400 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] reservation_expire = 86400 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] reserved_image_namespaces = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] reserved_percentage = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] rpc_response_timeout = 120 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] run_external_periodic_tasks = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] scst_target_driver = iscsi {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] scst_target_iqn_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_down_time = 720 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] shell_completion = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] snapshot_name_template = snapshot-%s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] split_loggers = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] state_path = /opt/stack/data/cinder {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] storage_availability_zone = nova {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] storage_protocol = iSCSI {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] syslog_log_facility = LOG_USER {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] target_helper = lioadm {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] target_ip_address = 192.168.122.163 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] target_port = 3260 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] target_protocol = iscsi {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] target_secondary_ip_addresses = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] trace_flags = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] transport_url = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] until_refresh = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] use_chap_auth = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] use_default_quota_class = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] use_journal = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] use_json = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] use_multipath_for_image_xfer = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] use_stderr = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] use_syslog = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] verify_glance_signatures = enabled {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_api_class = cinder.volume.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_backend_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_clear = zero {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_clear_ionice = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_clear_size = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_copy_bps_limit = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_dd_blocksize = 1M {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_name_template = volume-%s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_service_inithost_offload = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volume_usage_audit_period = month {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] zoning_mode = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_concurrency.disable_process_locking = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.auth_section = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.auth_type = password {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.auth_version = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.cache = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.include_service_catalog = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.insecure = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.interface = public {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_password = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: INFO cinder.volume.manager [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.remotefs [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93161) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcache_username = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.region_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.service_type = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.backend = dogpile.cache.null {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.backend_argument = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.backend_expiration_time = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.config_prefix = cache.oslo {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.debug_cache_backend = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.enable_retry_client = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.enable_socket_keepalive = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.expiration_time = 600 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.hashclient_retry_attempts = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.memcache_dead_retry = 300 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.memcache_pool_maxsize = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.memcache_sasl_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.password = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.proxies = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.redis_db = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.redis_server = localhost:6379 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.retry_attempts = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.retry_delay = 0.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.socket_keepalive_count = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.socket_keepalive_idle = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.socket_keepalive_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.socket_timeout = 1.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.tls_allowed_ciphers = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.tls_cafile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.tls_certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.tls_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.tls_keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cache.username = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] coordination.backend_url = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.asyncio_connection = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.asyncio_slave_connection = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.backend = sqlalchemy {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.connection = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.connection_debug = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.connection_parameters = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.connection_recycle_time = 3600 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.connection_trace = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.db_inc_retry_interval = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.db_max_retries = 20 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.db_max_retry_interval = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.db_retry_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.max_overflow = 50 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.max_pool_size = 5 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.max_retries = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.mysql_wsrep_sync_wait = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.pool_timeout = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.retry_interval = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.slave_connection = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.sqlite_synchronous = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.synchronous_reader = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] database.use_db_reconnect = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.connection_string = messaging:// {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.es_doc_type = notification {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.es_scroll_size = 10000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.es_scroll_time = 2m {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.filter_error_trace = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.hmac_keys = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.sentinel_service_name = mymaster {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.socket_timeout = 0.1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.trace_requests = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler.trace_sqlalchemy = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler_jaeger.process_tags = {} {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler_jaeger.service_name_prefix = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] profiler_otlp.service_name_prefix = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.enforce_new_defaults = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: WARNING oslo_config.cfg [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.enforce_scope = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.policy_default_rule = default {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.policy_file = policy.yaml {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] privsep_osbrick.group = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] privsep_osbrick.helper_command = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] privsep_osbrick.user = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_sys_admin.group = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_sys_admin.helper_command = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] cinder_sys_admin.user = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.auth_section = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.auth_type = password {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.cafile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.collect_timing = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.insecure = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.send_service_user_token = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.split_loggers = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] service_user.timeout = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.auth_section = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.auth_type = password {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.collect_timing = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.insecure = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.region_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.split_loggers = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] glance.timeout = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.backend_availability_zone = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.chap_password = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.chap_username = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.disk_geometry = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.driver_client_cert = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.driver_client_cert_key = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.driver_data_namespace = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.driver_use_ssl = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.extra_capabilities = {} {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.filter_function = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.goodness_function = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93161) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.iscsi_target_flags = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.iscsi_write_cache = on {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: WARNING cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.iser_helper = tgtadm {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: WARNING cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Running cmd (subprocess): mount.quobyte {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.iser_port = 3260 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_host = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_login = admin {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_mount_options = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_password = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_private_key = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_share_path = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.num_shell_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.quobyte_volume_url = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.replication_device = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.report_discard_supported = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.reserved_percentage = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.target_helper = tgtadm {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.target_port = 3260 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.target_protocol = iscsi {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.trace_flags = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.unique_fqdn_network = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.use_chap_auth = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volume_backend_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volume_clear = zero {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volume_clear_ionice = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volume_clear_size = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_reports.file_event_handler = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_reports.log_dir = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.backend_availability_zone = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.backend_host = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.chap_password = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.chap_username = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.chiscsi_conf = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.disk_geometry = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.driver_client_cert = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.driver_data_namespace = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.driver_use_ssl = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.extra_capabilities = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.filter_function = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.goodness_function = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.iser_helper = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.iser_ip_address = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.iser_port = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.iser_target_prefix = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_host = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_login = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_mount_options = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_password = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_private_key = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_share_path = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_ssh_port = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.num_shell_tries = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.nvmet_port_id = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.replication_device = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.report_discard_supported = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.reserved_percentage = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.scst_target_driver = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.storage_protocol = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.target_helper = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.target_ip_address = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.target_port = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.target_prefix = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.target_protocol = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.trace_flags = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.use_chap_auth = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volume_clear = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volume_clear_size = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] QuobyteHD.volumes_dir = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.ssl = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_notifications.driver = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_notifications.retry = -1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: INFO cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 ... Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] key_manager.fixed_key = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 -c /etc/quobyte/client-cinder.cfg {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.barbican_api_version = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.barbican_endpoint = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.barbican_endpoint_type = public {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.barbican_region_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.cafile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.collect_timing = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.insecure = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.number_of_retries = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.retry_delay = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.send_service_user_token = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.split_loggers = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.timeout = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.verify_ssl = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican.verify_ssl_path = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.auth_section = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.auth_type = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.cafile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.collect_timing = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.insecure = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.split_loggers = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] barbican_service_user.timeout = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.approle_role_id = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.approle_secret_id = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.kv_mountpoint = secret {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.kv_path = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.kv_version = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.namespace = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.root_token_id = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.ssl_ca_crt_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.timeout = 60.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.use_ssl = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:10:52 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] ******************************************************************************** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 20:10:52 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 -c /etc/quobyte/client-cinder.cfg Jun 23 20:10:52 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:53 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.784s {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:53 devstack cinder-volume[93161]: INFO cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 succeeded Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.794s {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:53 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:10:53 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:53 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.610s {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:53 devstack cinder-volume[93161]: INFO cinder.volume.driver [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Driver hasn't implemented _init_vendor_properties() Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG cinder.volume.driver [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578163146973, 'free_capacity_gb': 1775.7578163146973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93161) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_db.sqlalchemy.engines [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93161) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG dbcounter [-] [93161] Writer thread running {{(pid=93161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG cinder.db.api [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Building query based on filter {{(pid=93161) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG cinder.image.image_utils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93161) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 20:10:53 devstack cinder-volume[93161]: INFO cinder.keymgr.migration [None req-e886c7f3-5508-44b7-90ba-73d690fe4db6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:10:53 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:53 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:10:53 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:54 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.590s {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG cinder.manager [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Notifying Schedulers of capabilities ... {{(pid=93161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:10:54 devstack cinder-volume[93161]: INFO cinder.volume.manager [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Driver initialization completed successfully. Jun 23 20:10:54 devstack cinder-volume[93161]: INFO cinder.manager [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Initiating service 3 cleanup Jun 23 20:10:54 devstack cinder-volume[93161]: INFO cinder.manager [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Service 3 cleanup completed. Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG cinder.service [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Creating RPC server for service cinder-volume {{(pid=93161) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG cinder.service [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93161) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 20:10:54 devstack cinder-volume[93161]: INFO cinder.volume.manager [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:10:54 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:54 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:10:54 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:55 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:55 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.747s {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:55 devstack cinder-volume[93161]: INFO cinder.volume.manager [None req-cfffdc74-5cc2-4433-ba41-a3791af1584a None None] Driver post RPC initialization completed successfully. Jun 23 20:10:59 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-5b63e7a2-cea8-4bb9-9b50-8a5bd900834d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:10:59 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-5b63e7a2-cea8-4bb9-9b50-8a5bd900834d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:10:59 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-5b63e7a2-cea8-4bb9-9b50-8a5bd900834d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93161) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:10:59 devstack cinder-volume[93161]: DEBUG cinder.volume.drivers.quobyte [None req-5b63e7a2-cea8-4bb9-9b50-8a5bd900834d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93161) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:10:59 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-5b63e7a2-cea8-4bb9-9b50-8a5bd900834d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93161) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:10:59 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-5b63e7a2-cea8-4bb9-9b50-8a5bd900834d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:10:59 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:10:59 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:10:59 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jun 23 20:10:59 devstack cinder-volume[93161]: DEBUG oslo_concurrency.processutils [None req-5b63e7a2-cea8-4bb9-9b50-8a5bd900834d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.574s {{(pid=93161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:10:59 devstack cinder-volume[93161]: DEBUG cinder.manager [None req-5b63e7a2-cea8-4bb9-9b50-8a5bd900834d None None] Notifying Schedulers of capabilities ... {{(pid=93161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:11:01 devstack cinder-volume[92937]: INFO oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Caught SIGTERM, stopping children Jun 23 20:11:01 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Acquiring lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 20:11:01 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Acquired lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 20:11:01 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Releasing lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 20:11:01 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Stop services. {{(pid=92937) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 20:11:01 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Killing children. {{(pid=92937) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 20:11:01 devstack cinder-volume[92937]: INFO oslo_service.backend._eventlet.service [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Waiting on 1 children to exit Jun 23 20:11:05 devstack cinder-volume[93161]: DEBUG dbcounter [-] [93161] Writing DB stats cinder:SELECT=4 {{(pid=93161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:11:05 devstack cinder-volume[93161]: DEBUG dbcounter [-] [93161] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:11:06 devstack cinder-volume[93161]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 23 20:11:06 devstack cinder-volume[93455]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 20:11:06 devstack cinder-volume[93455]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 20:11:06 devstack cinder-volume[93455]: we strongly recommend against using it for new projects. Jun 23 20:11:06 devstack cinder-volume[93455]: If you are already using Eventlet, we recommend migrating to a different Jun 23 20:11:06 devstack cinder-volume[93455]: framework. For more detail see Jun 23 20:11:06 devstack cinder-volume[93455]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 20:11:06 devstack cinder-volume[93455]: import eventlet # noqa Jun 23 20:11:07 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Acquiring lock "singleton_lock" {{(pid=93161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 20:11:07 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Acquired lock "singleton_lock" {{(pid=93161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 20:11:07 devstack cinder-volume[93161]: DEBUG oslo_concurrency.lockutils [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Releasing lock "singleton_lock" {{(pid=93161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 20:11:07 devstack cinder-volume[93161]: WARNING amqp [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 20:11:07 devstack cinder-volume[93161]: WARNING amqp [None req-7f8949f4-ff31-4983-8287-e3e984747967 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 20:11:08 devstack cinder-volume[93455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 20:11:08 devstack cinder-volume[93455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 20:11:08 devstack cinder-volume[93455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 20:11:09 devstack cinder-volume[93455]: INFO dbcounter [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Registered counter for database cinder Jun 23 20:11:09 devstack cinder-volume[93455]: DEBUG oslo_db.sqlalchemy.engines [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93455) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:11:09 devstack cinder-volume[93455]: DEBUG dbcounter [-] [93455] Writer thread running {{(pid=93455) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 20:11:09 devstack cinder-volume[93455]: INFO cinder.rpc [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 20:11:09 devstack cinder-volume[93455]: INFO cinder.rpc [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_db.sqlalchemy.engines [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93455) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:11:10 devstack cinder-volume[93455]: INFO cinder.volume.manager [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Determined volume DB was empty at startup. Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG cinder.volume.manager [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93455) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 20:11:10 devstack cinder-volume[93455]: WARNING stevedore.named [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 20:11:10 devstack cinder-volume[93455]: WARNING castellan.key_manager [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 20:11:10 devstack cinder-volume[93455]: WARNING cinder.keymgr.conf_key_mgr [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 20:11:10 devstack cinder-volume[93455]: INFO cinder.volume.manager [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_db.sqlalchemy.engines [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93455) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:11:10 devstack cinder-volume[93455]: INFO oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Starting 1 workers Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Started child 93739 {{(pid=93455) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Full set of CONF: {{(pid=93455) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] ******************************************************************************** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Configuration options gathered from: {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] ================================================================================ {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] allow_availability_zone_fallback = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] allow_compression_on_image_upload = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] allowed_direct_url_schemes = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] api_rate_limit = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] auth_strategy = keystone {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_availability_zone = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_host = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_stats_polling_interval = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backup_api_class = cinder.backup.api.API {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backup_name_template = backup-%s {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backup_use_same_host = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93739]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backup_use_temp_snapshot = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] chap_password = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] chap_username = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_internal_tenant_project_id = 867bfc20ea91484d949d6afa4d414b3d {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_internal_tenant_user_id = 35c4e07b20c54a77b45d9a9f52aad010 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cluster = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] compression_format = gzip {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] compute_api_class = cinder.compute.nova.API {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] config_dir = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] config_source = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] control_exchange = openstack {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] debug = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] default_availability_zone = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] default_group_type = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] default_volume_type = QuobyteHD {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] disk_geometry = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] driver_client_cert = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] driver_client_cert_key = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] driver_data_namespace = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] driver_ssl_cert_path = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] driver_ssl_cert_verify = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] driver_use_ssl = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] enable_new_services = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] enable_unsupported_driver = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] enabled_backends = ['QuobyteHD'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] enforce_multipath_for_image_xfer = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] filter_function = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_api_insecure = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_api_ssl_compression = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_ca_certificates_file = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_catalog_info = image:glance:publicURL {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_certfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_keyfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_num_retries = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance_request_timeout = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] goodness_function = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] graceful_shutdown_timeout = 5 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] group_api_class = cinder.group.api.API {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] host = devstack {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_compress_on_upload = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_conversion_address_space_limit = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_conversion_cpu_limit = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_conversion_disable = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_upload_use_cinder_backend = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_upload_use_internal_tenant = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_volume_cache_enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_volume_cache_max_count = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] image_volume_cache_max_size_gb = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] init_host_max_objects_retrieval = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] instance_format = [instance: %(uuid)s] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] iscsi_target_flags = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] iscsi_write_cache = on {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] iser_helper = tgtadm {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] iser_ip_address = 192.168.122.163 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] iser_port = 3260 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_color = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_config_append = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_dir = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_file = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_options = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_rotate_interval = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_rotate_interval_type = days {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] log_rotation_type = none {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] max_age = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] max_logfile_count = 30 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] max_logfile_size_mb = 200 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] max_over_subscription_ratio = 20.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] message_reap_interval = 86400 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] message_ttl = 2592000 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] migration_create_volume_timeout_secs = 300 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] monkey_patch = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] monkey_patch_modules = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] my_ip = 192.168.122.163 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] no_snapshot_gb_quota = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] num_iser_scan_tries = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] num_shell_tries = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] num_volume_device_scan_tries = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] nvmeof_conn_info_version = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] nvmet_ns_id = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] nvmet_port_id = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] osapi_max_limit = 1000 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] osapi_volume_ext_list = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] osapi_volume_listen_port = 8776 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] osapi_volume_use_ssl = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] osapi_volume_workers = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] per_volume_size_limit = -1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] periodic_fuzzy_delay = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] periodic_interval = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] public_endpoint = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] publish_errors = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] quota_backup_gigabytes = 1000 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] quota_backups = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] quota_gigabytes = 1000 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] quota_groups = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] quota_snapshots = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] quota_volumes = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] rate_limit_burst = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] rate_limit_except_level = CRITICAL {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] rate_limit_interval = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] reinit_driver_count = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] replication_device = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] report_discard_supported = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93739) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] report_interval = 120 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] reservation_clean_interval = 86400 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] reservation_expire = 86400 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] reserved_image_namespaces = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] reserved_percentage = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] rpc_response_timeout = 120 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] run_external_periodic_tasks = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] scst_target_driver = iscsi {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] scst_target_iqn_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_down_time = 720 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] shell_completion = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] snapshot_name_template = snapshot-%s {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] split_loggers = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] state_path = /opt/stack/data/cinder {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] storage_availability_zone = nova {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] storage_protocol = iSCSI {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] syslog_log_facility = LOG_USER {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] target_helper = lioadm {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] target_ip_address = 192.168.122.163 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] target_port = 3260 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] target_protocol = iscsi {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] target_secondary_ip_addresses = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] trace_flags = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] transport_url = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] until_refresh = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] use_chap_auth = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] use_default_quota_class = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] use_journal = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] use_json = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] use_multipath_for_image_xfer = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] use_stderr = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] use_syslog = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] verify_glance_signatures = enabled {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_api_class = cinder.volume.api.API {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_backend_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_clear = zero {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_clear_ionice = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_clear_size = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_copy_bps_limit = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_dd_blocksize = 1M {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_name_template = volume-%s {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_service_inithost_offload = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volume_usage_audit_period = month {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] zoning_mode = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_concurrency.disable_process_locking = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.auth_section = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.auth_type = password {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.auth_version = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.cache = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.certfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.include_service_catalog = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.insecure = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.interface = public {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.keyfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_password = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcache_username = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.region_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.service_type = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.backend = dogpile.cache.null {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.backend_argument = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.backend_expiration_time = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.config_prefix = cache.oslo {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.debug_cache_backend = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.enable_retry_client = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.enable_socket_keepalive = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.expiration_time = 600 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.hashclient_retry_attempts = 2 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.memcache_dead_retry = 300 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.memcache_pool_maxsize = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.memcache_sasl_enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.password = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.proxies = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.redis_db = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.redis_server = localhost:6379 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.retry_attempts = 2 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.retry_delay = 0.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.socket_keepalive_count = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.socket_keepalive_idle = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.socket_keepalive_interval = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.socket_timeout = 1.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.tls_allowed_ciphers = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.tls_cafile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.tls_certfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.tls_enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.tls_keyfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cache.username = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] coordination.backend_url = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.asyncio_connection = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.asyncio_slave_connection = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.backend = sqlalchemy {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.connection = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.connection_debug = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.connection_parameters = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.connection_recycle_time = 3600 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.connection_trace = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.db_inc_retry_interval = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.db_max_retries = 20 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.db_max_retry_interval = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.db_retry_interval = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.max_overflow = 50 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.max_pool_size = 5 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.max_retries = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.mysql_wsrep_sync_wait = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.pool_timeout = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.retry_interval = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.slave_connection = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.sqlite_synchronous = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.synchronous_reader = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] database.use_db_reconnect = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.connection_string = messaging:// {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.es_doc_type = notification {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.es_scroll_size = 10000 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.es_scroll_time = 2m {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.filter_error_trace = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.hmac_keys = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.sentinel_service_name = mymaster {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.socket_timeout = 0.1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.trace_requests = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler.trace_sqlalchemy = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler_jaeger.process_tags = {} {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler_jaeger.service_name_prefix = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] profiler_otlp.service_name_prefix = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.enforce_new_defaults = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: WARNING oslo_config.cfg [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.enforce_scope = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.policy_default_rule = default {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.policy_file = policy.yaml {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] privsep_osbrick.group = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] privsep_osbrick.helper_command = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] privsep_osbrick.user = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_sys_admin.group = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_sys_admin.helper_command = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93739) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 20:11:10 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] cinder_sys_admin.user = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.auth_section = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.auth_type = password {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.cafile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.certfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.collect_timing = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.insecure = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.keyfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.send_service_user_token = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.split_loggers = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] service_user.timeout = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Running cmd (subprocess): mount.quobyte {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.auth_section = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.auth_type = password {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.certfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.collect_timing = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.insecure = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.keyfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.region_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.split_loggers = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] glance.timeout = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.backend_availability_zone = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.chap_password = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.chap_username = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.disk_geometry = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.driver_client_cert = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.driver_client_cert_key = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.driver_data_namespace = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.driver_use_ssl = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.extra_capabilities = {} {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.filter_function = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.goodness_function = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.iscsi_target_flags = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.iscsi_write_cache = on {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.iser_helper = tgtadm {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.iser_port = 3260 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_host = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_login = admin {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_mount_options = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_password = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_private_key = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_share_path = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.num_shell_tries = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.quobyte_volume_url = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.replication_device = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.report_discard_supported = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.reserved_percentage = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.target_helper = tgtadm {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.target_port = 3260 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.target_protocol = iscsi {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.trace_flags = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.unique_fqdn_network = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.use_chap_auth = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volume_backend_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volume_clear = zero {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volume_clear_ionice = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volume_clear_size = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_reports.file_event_handler = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_reports.log_dir = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.backend_availability_zone = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.backend_host = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.chap_password = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.chap_username = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.chiscsi_conf = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.disk_geometry = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.driver_client_cert = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.driver_data_namespace = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.driver_use_ssl = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.extra_capabilities = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.filter_function = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.goodness_function = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.iser_helper = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.iser_ip_address = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.iser_port = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.iser_target_prefix = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_host = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_login = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_mount_options = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_password = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_private_key = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_share_path = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_ssh_port = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.num_shell_tries = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.nvmet_port_id = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.replication_device = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.report_discard_supported = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.reserved_percentage = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.scst_target_driver = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.storage_protocol = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.target_helper = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.target_ip_address = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.target_port = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.target_prefix = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.target_protocol = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.trace_flags = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.use_chap_auth = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volume_clear = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volume_clear_size = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack quobyte-client[93745]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] QuobyteHD.volumes_dir = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack quobyte-client[93745]: Invalid parameters found, error: missing mount point. Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack quobyte-client[93745]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack quobyte-client[93745]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.ssl = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_notifications.driver = [] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_notifications.retry = -1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] key_manager.fixed_key = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.barbican_api_version = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.barbican_endpoint = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.barbican_endpoint_type = public {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.barbican_region_name = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.cafile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.certfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.collect_timing = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.insecure = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.keyfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.number_of_retries = 60 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.retry_delay = 1 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.send_service_user_token = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.split_loggers = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.timeout = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.verify_ssl = True {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican.verify_ssl_path = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.auth_section = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.auth_type = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.cafile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.certfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.collect_timing = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.insecure = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.keyfile = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.split_loggers = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] barbican_service_user.timeout = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.approle_role_id = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.approle_secret_id = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.kv_mountpoint = secret {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.kv_path = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.kv_version = 2 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.namespace = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.root_token_id = **** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.ssl_ca_crt_file = None {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.timeout = 60.0 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.use_ssl = False {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 20:11:10 devstack cinder-volume[93455]: DEBUG oslo_service.backend._eventlet.service [None req-27dc2224-ade1-47c9-8fc0-7e7c7a485913 None None] ******************************************************************************** {{(pid=93455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 20:11:10 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:11:10 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:11:11 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.636s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:11:11 devstack cinder-volume[93739]: INFO cinder.volume.driver [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.volume.driver [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578163146973, 'free_capacity_gb': 1775.7578163146973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93739) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_db.sqlalchemy.engines [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93739) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writer thread running {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.db.api [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Building query based on filter {{(pid=93739) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93739) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:11:11 devstack cinder-volume[93739]: INFO cinder.keymgr.migration [None req-319abfb7-96c4-43ae-b880-6f8fe4e4d4e8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 20:11:11 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:11:11 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:11:11 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.647s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:11:11 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Driver initialization completed successfully. Jun 23 20:11:11 devstack cinder-volume[93739]: INFO cinder.manager [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Initiating service 3 cleanup Jun 23 20:11:11 devstack cinder-volume[93739]: INFO cinder.manager [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Service 3 cleanup completed. Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.service [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Creating RPC server for service cinder-volume {{(pid=93739) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.service [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93739) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 20:11:11 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:11:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:11:12 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:11:12 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:11:12 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jun 23 20:11:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.646s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:11:12 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2b120d6d-293e-40a8-85e4-b34d8a2cb445 None None] Driver post RPC initialization completed successfully. Jun 23 20:11:20 devstack cinder-volume[93455]: DEBUG dbcounter [-] [93455] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93455) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:11:21 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:11:22 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:11:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:11:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 6 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:11:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Flow 'volume_create_manager' (b67420cf-b00c-4c3b-85cc-71b84e5bfb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668da003-91bc-405b-a97f-704c76c05c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668da003-91bc-405b-a97f-704c76c05c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-48343046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab858ff-fe54-456a-bf1d-236be1d8e459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f7ad873a5a4bbe8a94d79af3c19fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:12:09Z,use_quota=True,user_id='f97fe9b553c444af863750303f737a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fca4913-4499-4863-ad2e-0be7a74c5c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fca4913-4499-4863-ad2e-0be7a74c5c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ce8a36-c10c-46c4-ba03-4f0f01304970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ce8a36-c10c-46c4-ba03-4f0f01304970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab858ff-fe54-456a-bf1d-236be1d8e459', 'volume_name': 'volume-aab858ff-fe54-456a-bf1d-236be1d8e459', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9206ca70-f7fa-4f5f-8489-8987deca09c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9206ca70-f7fa-4f5f-8489-8987deca09c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99eebb46-011d-4875-96a7-9fae185cecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:08 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Volume aab858ff-fe54-456a-bf1d-236be1d8e459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab858ff-fe54-456a-bf1d-236be1d8e459', 'volume_size': 1} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-48343046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab858ff-fe54-456a-bf1d-236be1d8e459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f7ad873a5a4bbe8a94d79af3c19fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:12:09Z,use_quota=True,user_id='f97fe9b553c444af863750303f737a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Creating volume aab858ff-fe54-456a-bf1d-236be1d8e459 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:12:08 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:12:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:08 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 1073741824 Jun 23 20:12:08 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:10 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 1073741824" returned: 0 in 1.177s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:10 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 Jun 23 20:12:10 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:10 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459" returned: 0 in 0.704s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99eebb46-011d-4875-96a7-9fae185cecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab858ff-fe54-456a-bf1d-236be1d8e459', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8952abd6-53d5-4a51-97c1-59704fd049f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:10 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Volume volume-aab858ff-fe54-456a-bf1d-236be1d8e459 (aab858ff-fe54-456a-bf1d-236be1d8e459): created successfully Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8952abd6-53d5-4a51-97c1-59704fd049f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Flow 'volume_create_manager' (b67420cf-b00c-4c3b-85cc-71b84e5bfb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:12:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1b011646-41d2-484a-99db-514c126cabd5 tempest-TaggedAttachmentsTest-1312262594 None] Created volume successfully. Jun 23 20:12:20 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:12:20 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Flow 'volume_create_manager' (4a47a1e0-060d-4940-9b25-399db39a2ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18359264-16c6-45d3-b9af-6ffa63ca15dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18359264-16c6-45d3-b9af-6ffa63ca15dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-496420335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9fbd25-c79d-49db-8ba0-0632efacd759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67190cd44204fb0a5232791f9dd220c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:12:32Z,use_quota=True,user_id='6b625d70372544e6bac9f1177ff42f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd8e27d-bb22-47a4-bbf5-ea49ed22d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd8e27d-bb22-47a4-bbf5-ea49ed22d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ed3ceb-3f4e-4d5e-8382-26974ba0a6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ed3ceb-3f4e-4d5e-8382-26974ba0a6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9fbd25-c79d-49db-8ba0-0632efacd759', 'volume_name': 'volume-ac9fbd25-c79d-49db-8ba0-0632efacd759', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61318559-4c83-4a7c-ac37-41fd08fd3330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61318559-4c83-4a7c-ac37-41fd08fd3330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1e564e-e1ed-4f24-95e8-14312d3d4fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:32 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Volume ac9fbd25-c79d-49db-8ba0-0632efacd759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9fbd25-c79d-49db-8ba0-0632efacd759', 'volume_size': 1} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-496420335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9fbd25-c79d-49db-8ba0-0632efacd759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67190cd44204fb0a5232791f9dd220c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:12:32Z,use_quota=True,user_id='6b625d70372544e6bac9f1177ff42f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Creating volume ac9fbd25-c79d-49db-8ba0-0632efacd759 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:12:32 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:12:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:32 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 1073741824 Jun 23 20:12:32 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:33 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 1073741824" returned: 0 in 1.402s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:33 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 Jun 23 20:12:33 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:34 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759" returned: 0 in 0.644s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:12:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1e564e-e1ed-4f24-95e8-14312d3d4fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9fbd25-c79d-49db-8ba0-0632efacd759', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc78caa-6466-4ba9-bc6c-781d5265aa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Volume volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 (ac9fbd25-c79d-49db-8ba0-0632efacd759): created successfully Jun 23 20:12:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc78caa-6466-4ba9-bc6c-781d5265aa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Flow 'volume_create_manager' (4a47a1e0-060d-4940-9b25-399db39a2ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:12:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-516cbab1-f053-4b00-8c9c-e0432dbbca0b tempest-DeleteServersTestJSON-100841637 None] Created volume successfully. Jun 23 20:12:44 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:12:44 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:12:44 devstack cinder-volume[93739]: WARNING py.warnings [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 23 20:12:44 devstack cinder-volume[93739]: .first() Jun 23 20:12:44 devstack cinder-volume[93739]: Jun 23 20:12:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:44 devstack cinder-volume[93739]: INFO oslo.privsep.daemon [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3z32n5vm/privsep.sock'] Jun 23 20:12:44 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3z32n5vm/privsep.sock Jun 23 20:12:44 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 20:12:45 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 23 20:12:45 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:12:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Flow 'volume_create_manager' (f9427391-4ab2-47c3-87c3-3fb87fb4cbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:12:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e57761-4cd0-457b-9dfa-77f63328cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e57761-4cd0-457b-9dfa-77f63328cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2034187536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3c23729aec401ab9c43afda35f61b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:12:46Z,use_quota=True,user_id='0579e26d6c0a4e48865ffba2f6a892cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63891e9-4a04-4b26-8a85-d9dc3082c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63891e9-4a04-4b26-8a85-d9dc3082c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4eb707-0440-461f-8744-94184ccb2b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4eb707-0440-461f-8744-94184ccb2b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac', 'volume_name': 'volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6606336a-c20c-400a-87a8-757d85d96479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6606336a-c20c-400a-87a8-757d85d96479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ca48d4-5f87-4187-b5c1-3f8e55128095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:46 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Volume 99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac', 'volume_size': 1} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:46 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:12:46 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 20:12:46 devstack cinder-volume[93739]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 23 20:12:47 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:47 devstack cinder-volume[93739]: INFO oslo.privsep.daemon [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] Spawned new privsep daemon via rootwrap Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] Accepted privsep connection to /tmp/tmp3z32n5vm/privsep.sock {{(pid=93739) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 23 20:12:47 devstack cinder-volume[93739]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 23 20:12:47 devstack cinder-volume[93739]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 23 20:12:47 devstack cinder-volume[93739]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 23 20:12:47 devstack cinder-volume[93739]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95007 Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d2d7fc-db74-4ffb-a1ce-8a2934b44a8f]: (2,) {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad28e6-672a-4fa2-9505-68b8c604b6b4]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:47 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.097s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:12:47 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 8 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:12:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:12:47 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:49 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759" returned: 0 in 1.901s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.746s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.478s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2034187536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3c23729aec401ab9c43afda35f61b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:12:46Z,use_quota=True,user_id='0579e26d6c0a4e48865ffba2f6a892cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Creating volume 99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:12:49 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:49 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac 1073741824 Jun 23 20:12:49 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-ac9fbd25-c79d-49db-8ba0-0632efacd759', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8905456-cb77-446b-b3c0-091ec700be97', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:12:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-4238d6f0-9f2c-4f03-8da1-ffee86366005 req-1a78e84a-dee5-4897-9434-74519883d82a tempest-DeleteServersTestJSON-100841637 None] attachment_update completed successfully. Jun 23 20:12:51 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac 1073741824" returned: 0 in 2.106s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:51 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac Jun 23 20:12:51 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:53 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac" returned: 0 in 1.634s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] <== create_volume: return (3833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:12:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.844s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ca48d4-5f87-4187-b5c1-3f8e55128095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb088d8-7def-4622-8619-dac21a02b3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:12:53 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Volume volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac (99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac): created successfully Jun 23 20:12:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb088d8-7def-4622-8619-dac21a02b3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:12:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Flow 'volume_create_manager' (f9427391-4ab2-47c3-87c3-3fb87fb4cbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:12:53 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ff824e1a-7baf-4f42-9bd0-fc0255675db4 tempest-VolumesAdminNegativeTest-1007935211 None] Created volume successfully. Jun 23 20:12:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Acquiring lock "cinder-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:12:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Lock "cinder-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:12:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Acquiring lock "cinder-quobyte-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:12:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Lock "cinder-quobyte-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:12:55 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a26661-4524-4495-8531-44f4e8b6dbd0]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:12:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:55 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac Jun 23 20:12:55 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:57 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac" returned: 0 in 1.673s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:57 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac Jun 23 20:12:57 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:12:58 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jun 23 20:12:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac" returned: 0 in 0.848s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:12:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Lock "cinder-quobyte-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac" released by "delete_volume" :: held 2.588s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:12:58 devstack cinder-volume[93739]: WARNING cinder.quota [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:12:58 devstack cinder-volume[93739]: WARNING cinder.quota [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:12:58 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Created reservations ['dfe04995-681a-4c90-b456-cea9e4846151', '59981a8d-eee4-4360-805b-1f71d8a123b7', '342fddd0-390b-4125-aa53-5ac42691ab4d', '56a80bde-d002-4105-b0f6-a668fee8a5ae'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:12:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:12:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:12:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:12:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:12:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:12:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:12:59 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:12:59 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:00 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.086s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:00 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:13:00 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Deleted volume successfully. Jun 23 20:13:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-13570ca3-8cdc-4584-8dd1-96a1d6efb71f tempest-VolumesAdminNegativeTest-1007935211 None] Lock "cinder-99aa19bc-f23b-4f5a-bbf9-8624b99cb0ac-delete_volume" released by "delete_volume" :: held 4.643s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:03 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-6ecd736d-dcd2-49cf-a51d-8d4499a5d2c7 req-d5895b13-0e5a-4d19-a0d2-3a41c4e420ab tempest-DeleteServersTestJSON-100841637 None] Terminate volume connection completed successfully. Jun 23 20:13:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-6ecd736d-dcd2-49cf-a51d-8d4499a5d2c7 req-d5895b13-0e5a-4d19-a0d2-3a41c4e420ab tempest-DeleteServersTestJSON-100841637 None] Deleting attachment d8905456-cb77-446b-b3c0-091ec700be97. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:13:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Acquiring lock "cinder-ac9fbd25-c79d-49db-8ba0-0632efacd759-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:13:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Lock "cinder-ac9fbd25-c79d-49db-8ba0-0632efacd759-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:13:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Acquiring lock "cinder-quobyte-ac9fbd25-c79d-49db-8ba0-0632efacd759" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:13:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Lock "cinder-quobyte-ac9fbd25-c79d-49db-8ba0-0632efacd759" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:13:08 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86bbfb6-c4e4-4de7-acf5-d3cba61f68aa]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:13:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:08 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 Jun 23 20:13:08 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:09 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759" returned: 0 in 1.333s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:09 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759 Jun 23 20:13:09 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:10 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ac9fbd25-c79d-49db-8ba0-0632efacd759" returned: 0 in 0.756s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Lock "cinder-quobyte-ac9fbd25-c79d-49db-8ba0-0632efacd759" released by "delete_volume" :: held 2.163s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Created reservations ['28e86551-11fe-4170-83d9-f597b25bcfe3', 'dfa03d97-ce34-4384-b00f-eb98372ea0c9', '8d80dcb9-8ce3-4508-a2db-a89359b5999f', '4e300d10-893e-467e-a6d0-b92e177a14dd'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:10 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:13:10 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:11 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.724s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:11 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:13:11 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Deleted volume successfully. Jun 23 20:13:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-04d9ac89-1da6-4c5e-8483-0122f7ef9ecb tempest-DeleteServersTestJSON-100841637 None] Lock "cinder-ac9fbd25-c79d-49db-8ba0-0632efacd759-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Flow 'volume_create_manager' (baa7d627-4320-44d2-956c-6e3bb0b0d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f142a11b-879e-4584-b31d-62c747fcf150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f142a11b-879e-4584-b31d-62c747fcf150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1658319155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8c89e6733694dddb349845840d2ec7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:13:21Z,use_quota=True,user_id='011c427fa43f45e5949601c1534bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840af94f-a477-4991-b77e-5557abc29bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840af94f-a477-4991-b77e-5557abc29bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b30ca4-9358-455f-9e11-68f9ee432067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b30ca4-9358-455f-9e11-68f9ee432067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87', 'volume_name': 'volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b181ec-717d-4aa3-ba77-0c9a4f1e3ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b181ec-717d-4aa3-ba77-0c9a4f1e3ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67ee87d-29ed-464c-adda-c0848a422821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:20 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Volume b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87', 'volume_size': 1} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1658319155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8c89e6733694dddb349845840d2ec7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:13:21Z,use_quota=True,user_id='011c427fa43f45e5949601c1534bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Creating volume b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:13:20 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:13:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:20 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 1073741824 Jun 23 20:13:20 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:21 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 1073741824" returned: 0 in 0.913s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:21 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 Jun 23 20:13:21 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:22 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87" returned: 0 in 0.698s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:13:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67ee87d-29ed-464c-adda-c0848a422821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e4f990-ad86-4cf2-b428-9ccd28560541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:22 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Volume volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 (b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87): created successfully Jun 23 20:13:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e4f990-ad86-4cf2-b428-9ccd28560541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Flow 'volume_create_manager' (baa7d627-4320-44d2-956c-6e3bb0b0d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:13:22 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-81cd26ba-a967-4634-9b15-a0541d5a9524 tempest-VolumesTestJSON-256531714 None] Created volume successfully. Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Flow 'volume_create_manager' (f7759975-99ea-4ff4-a108-c818a8f08b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5026e15-af11-4ddd-8717-4282872adc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5026e15-af11-4ddd-8717-4282872adc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-973110840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291680b2-5c38-4a49-a714-66574dd024e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8c89e6733694dddb349845840d2ec7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:13:23Z,use_quota=True,user_id='011c427fa43f45e5949601c1534bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af507e2-30e7-4805-b21d-006867b806b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af507e2-30e7-4805-b21d-006867b806b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b5db81-6fbe-497e-9e18-188505ea3142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b5db81-6fbe-497e-9e18-188505ea3142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291680b2-5c38-4a49-a714-66574dd024e5', 'volume_name': 'volume-291680b2-5c38-4a49-a714-66574dd024e5', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063d4ca7-e9f8-4664-bdd1-441072cdcab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063d4ca7-e9f8-4664-bdd1-441072cdcab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccc63fa-facf-480a-9ee9-31eb9dd0621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:23 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Volume 291680b2-5c38-4a49-a714-66574dd024e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291680b2-5c38-4a49-a714-66574dd024e5', 'volume_size': 1} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-973110840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291680b2-5c38-4a49-a714-66574dd024e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8c89e6733694dddb349845840d2ec7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:13:23Z,use_quota=True,user_id='011c427fa43f45e5949601c1534bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Creating volume 291680b2-5c38-4a49-a714-66574dd024e5 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:13:23 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:13:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:23 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 1073741824 Jun 23 20:13:23 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:24 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 1073741824" returned: 0 in 0.981s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:24 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 Jun 23 20:13:24 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:25 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5" returned: 0 in 1.018s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:13:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccc63fa-facf-480a-9ee9-31eb9dd0621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291680b2-5c38-4a49-a714-66574dd024e5', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6651d8-2151-4477-8321-0f305dac5fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:25 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Volume volume-291680b2-5c38-4a49-a714-66574dd024e5 (291680b2-5c38-4a49-a714-66574dd024e5): created successfully Jun 23 20:13:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6651d8-2151-4477-8321-0f305dac5fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Flow 'volume_create_manager' (f7759975-99ea-4ff4-a108-c818a8f08b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:13:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-6be0e8bf-1948-4ccc-b3a1-4de7c04459fb tempest-VolumesTestJSON-256531714 None] Created volume successfully. Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Flow 'volume_create_manager' (f4aafb1a-a7af-4be8-acf1-955abced0b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048eaee6-ca68-4076-9324-38a560640938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048eaee6-ca68-4076-9324-38a560640938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-881625395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63d3e3d-5695-493f-a6a9-472b1f0940d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8c89e6733694dddb349845840d2ec7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:13:28Z,use_quota=True,user_id='011c427fa43f45e5949601c1534bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79d2194-c363-4147-81cb-84fbb96c371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79d2194-c363-4147-81cb-84fbb96c371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef56e34-1c68-478d-bf76-f7f7f3757024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef56e34-1c68-478d-bf76-f7f7f3757024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63d3e3d-5695-493f-a6a9-472b1f0940d0', 'volume_name': 'volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e9b031-93f0-4a73-b6b6-b13501ca6ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e9b031-93f0-4a73-b6b6-b13501ca6ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c5cb35-6d0c-45fe-98b3-cc95f58035f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:28 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Volume d63d3e3d-5695-493f-a6a9-472b1f0940d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0', 'volume_size': 1} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-881625395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63d3e3d-5695-493f-a6a9-472b1f0940d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8c89e6733694dddb349845840d2ec7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:13:28Z,use_quota=True,user_id='011c427fa43f45e5949601c1534bb333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Creating volume d63d3e3d-5695-493f-a6a9-472b1f0940d0 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:13:28 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:13:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:28 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 1073741824 Jun 23 20:13:28 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:29 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 1073741824" returned: 0 in 1.338s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:29 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 Jun 23 20:13:29 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:30 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0" returned: 0 in 0.831s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:13:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c5cb35-6d0c-45fe-98b3-cc95f58035f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (652c6e25-116f-4713-b69f-390f67460442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:30 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Volume volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 (d63d3e3d-5695-493f-a6a9-472b1f0940d0): created successfully Jun 23 20:13:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (652c6e25-116f-4713-b69f-390f67460442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Flow 'volume_create_manager' (f4aafb1a-a7af-4be8-acf1-955abced0b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:13:30 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e58eaf2c-dd21-4d09-a5bd-76f8d8bc8882 tempest-VolumesTestJSON-256531714 None] Created volume successfully. Jun 23 20:13:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-6570ffb9-aee7-4507-a9b3-1cef01ae3c06 req-3f9df2f2-4252-4af8-bca9-38c44f07d311 tempest-TaggedAttachmentsTest-1312262594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-6570ffb9-aee7-4507-a9b3-1cef01ae3c06 req-3f9df2f2-4252-4af8-bca9-38c44f07d311 tempest-TaggedAttachmentsTest-1312262594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:32 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8717d6-04dd-41a8-82c2-4c691c07183c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:13:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-6570ffb9-aee7-4507-a9b3-1cef01ae3c06 req-3f9df2f2-4252-4af8-bca9-38c44f07d311 tempest-TaggedAttachmentsTest-1312262594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:32 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 Jun 23 20:13:32 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Acquiring lock "cinder-d63d3e3d-5695-493f-a6a9-472b1f0940d0-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Lock "cinder-d63d3e3d-5695-493f-a6a9-472b1f0940d0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Acquiring lock "cinder-quobyte-d63d3e3d-5695-493f-a6a9-472b1f0940d0" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Lock "cinder-quobyte-d63d3e3d-5695-493f-a6a9-472b1f0940d0" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16fe1d-4940-46ea-b8ef-b80c5b202a2b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:33 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 Jun 23 20:13:33 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:33 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-6570ffb9-aee7-4507-a9b3-1cef01ae3c06 req-3f9df2f2-4252-4af8-bca9-38c44f07d311 tempest-TaggedAttachmentsTest-1312262594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459" returned: 0 in 1.423s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-6570ffb9-aee7-4507-a9b3-1cef01ae3c06 req-3f9df2f2-4252-4af8-bca9-38c44f07d311 tempest-TaggedAttachmentsTest-1312262594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.457s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-6570ffb9-aee7-4507-a9b3-1cef01ae3c06 req-3f9df2f2-4252-4af8-bca9-38c44f07d311 tempest-TaggedAttachmentsTest-1312262594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-aab858ff-fe54-456a-bf1d-236be1d8e459', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29583f67-0345-4997-913c-67de7c082193', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:13:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-6570ffb9-aee7-4507-a9b3-1cef01ae3c06 req-3f9df2f2-4252-4af8-bca9-38c44f07d311 tempest-TaggedAttachmentsTest-1312262594 None] attachment_update completed successfully. Jun 23 20:13:34 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0" returned: 0 in 1.121s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:34 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0 Jun 23 20:13:34 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:35 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d63d3e3d-5695-493f-a6a9-472b1f0940d0" returned: 0 in 1.120s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Lock "cinder-quobyte-d63d3e3d-5695-493f-a6a9-472b1f0940d0" released by "delete_volume" :: held 2.322s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:36 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Created reservations ['3b683452-0ed5-40f6-b164-23d51a7c29c3', '3e548b92-4020-4546-8725-a501b09739fd', 'a0959c4b-356f-413b-868e-25d148e23d01', 'f9f448a6-b6e3-4dfd-bcd3-71945fe72006'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:13:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:36 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:13:36 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Acquiring lock "cinder-291680b2-5c38-4a49-a714-66574dd024e5-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Lock "cinder-291680b2-5c38-4a49-a714-66574dd024e5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:13:37 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.009s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:13:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Deleted volume successfully. Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Acquiring lock "cinder-quobyte-291680b2-5c38-4a49-a714-66574dd024e5" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Lock "cinder-quobyte-291680b2-5c38-4a49-a714-66574dd024e5" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-00f1d3ee-f78d-4a8f-b799-8e5324f062a0 tempest-VolumesTestJSON-256531714 None] Lock "cinder-d63d3e3d-5695-493f-a6a9-472b1f0940d0-delete_volume" released by "delete_volume" :: held 3.878s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0a1f64-ab7c-4800-b60d-e04c30db2510]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:13:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:37 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 Jun 23 20:13:37 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:38 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5" returned: 0 in 1.162s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:38 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5 Jun 23 20:13:38 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:39 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-291680b2-5c38-4a49-a714-66574dd024e5" returned: 0 in 0.702s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Lock "cinder-quobyte-291680b2-5c38-4a49-a714-66574dd024e5" released by "delete_volume" :: held 1.905s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Created reservations ['d7dc633e-826e-4137-9e1f-9740c5420634', '603eb8d5-5deb-46b9-8278-b1417e7d5e8b', '60b2cb2e-d5de-401a-b72c-7351beee7cbb', 'e5c14598-4502-4f06-8b16-217e08221058'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:39 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:13:39 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:40 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.694s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:13:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Deleted volume successfully. Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23579e4e-1cdd-43c1-882b-e05ab1d128dd tempest-VolumesTestJSON-256531714 None] Lock "cinder-291680b2-5c38-4a49-a714-66574dd024e5-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Acquiring lock "cinder-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Lock "cinder-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Acquiring lock "cinder-quobyte-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Lock "cinder-quobyte-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c362b-3397-4af9-9572-0430eb9b775b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:13:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:40 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 Jun 23 20:13:40 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:41 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87" returned: 0 in 0.858s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:41 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87 Jun 23 20:13:41 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:42 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87" returned: 0 in 0.735s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Lock "cinder-quobyte-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87" released by "delete_volume" :: held 1.641s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Created reservations ['0a6db7d5-d7eb-4915-8874-4abb183aa9dd', 'af7b7038-b998-496a-9299-ee8dd2c8129b', '779a783a-121e-405c-8c21-552380db4090', '5e1c8cc8-7ded-494e-8442-c4b57083e7cb'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:13:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-35309103-4a2e-4846-8d1f-e8a738b1b0d2 req-456f1dc8-c3ba-47f1-8c26-ff0ecd7779f1 tempest-TaggedAttachmentsTest-1312262594 None] Terminate volume connection completed successfully. Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-35309103-4a2e-4846-8d1f-e8a738b1b0d2 req-456f1dc8-c3ba-47f1-8c26-ff0ecd7779f1 tempest-TaggedAttachmentsTest-1312262594 None] Deleting attachment 29583f67-0345-4997-913c-67de7c082193. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:42 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:13:42 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:43 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.783s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:43 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:13:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Deleted volume successfully. Jun 23 20:13:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-669e7816-c20a-4c2b-81df-cf83fefb331f tempest-VolumesTestJSON-256531714 None] Lock "cinder-b15ac8cf-ec64-4fbc-bbbe-cb672fd04d87-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:13:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:13:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:46 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:13:46 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:47 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.859s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:13:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-53bf1062-ede1-4ee4-902d-8a7aa749b5dc tempest-BackendsCapabilitiesAdminTestsJSON-1092259705 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578163146973, 'free_capacity_gb': 1775.7578163146973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93739) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 20:13:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0a436415-08af-4618-a4af-3412c973a267 tempest-BackendsCapabilitiesAdminTestsJSON-1092259705 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578163146973, 'free_capacity_gb': 1775.7578163146973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93739) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 20:13:52 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=40,cinder:UPDATE=59,cinder:DELETE=6,cinder:INSERT=13 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:13:52 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=54,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=3 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:13:52 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Flow 'volume_create_manager' (b2d34e1d-5b91-41fe-9fa8-c1dd21abc99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1354a6b6-d2fa-4324-bfb7-3aba7fae4326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1354a6b6-d2fa-4324-bfb7-3aba7fae4326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1226357232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989dead4-89d9-4e31-89aa-7bd507f8c53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb670ad0b6044165a1ca456df5a69b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:13:53Z,use_quota=True,user_id='198f14c1a2b54b79a855c089b32c056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7b4525-6f87-4200-ae51-38d55ecf38b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7b4525-6f87-4200-ae51-38d55ecf38b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5500439-db00-416c-ba9d-4e993801aea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5500439-db00-416c-ba9d-4e993801aea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989dead4-89d9-4e31-89aa-7bd507f8c53b', 'volume_name': 'volume-989dead4-89d9-4e31-89aa-7bd507f8c53b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d670c038-6fb4-434d-90b8-f877b6cce6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d670c038-6fb4-434d-90b8-f877b6cce6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315c75b2-7940-4085-a55f-72f39574a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:53 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Volume 989dead4-89d9-4e31-89aa-7bd507f8c53b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989dead4-89d9-4e31-89aa-7bd507f8c53b', 'volume_size': 1} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1226357232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989dead4-89d9-4e31-89aa-7bd507f8c53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb670ad0b6044165a1ca456df5a69b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:13:53Z,use_quota=True,user_id='198f14c1a2b54b79a855c089b32c056c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Creating volume 989dead4-89d9-4e31-89aa-7bd507f8c53b {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:13:53 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:13:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:53 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b 1073741824 Jun 23 20:13:53 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:54 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b 1073741824" returned: 0 in 1.336s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:54 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b Jun 23 20:13:54 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:13:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b" returned: 0 in 1.200s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:13:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] <== create_volume: return (2632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:13:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.635s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:55 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jun 23 20:13:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315c75b2-7940-4085-a55f-72f39574a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989dead4-89d9-4e31-89aa-7bd507f8c53b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad53d95-8ab0-4951-9970-d3af6599690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:13:55 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Volume volume-989dead4-89d9-4e31-89aa-7bd507f8c53b (989dead4-89d9-4e31-89aa-7bd507f8c53b): created successfully Jun 23 20:13:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad53d95-8ab0-4951-9970-d3af6599690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:13:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Flow 'volume_create_manager' (b2d34e1d-5b91-41fe-9fa8-c1dd21abc99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:13:55 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f2c1e2be-b569-4672-a466-97e310685c16 tempest-ServerActionsTestOtherA-1591604329 None] Created volume successfully. Jun 23 20:13:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1c69ee7b-3acf-45cf-aa49-baf4b22b409f tempest-GroupsV320Test-1871072335 None] Group tempest-GroupsV320Test-Group-1848811664: creating Jun 23 20:13:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1c69ee7b-3acf-45cf-aa49-baf4b22b409f tempest-GroupsV320Test-1871072335 None] Group tempest-GroupsV320Test-Group-1848811664: created successfully Jun 23 20:13:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1c69ee7b-3acf-45cf-aa49-baf4b22b409f tempest-GroupsV320Test-1871072335 None] Create group completed successfully. Jun 23 20:13:59 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Created reservations ['e8e6443a-e992-46ca-a5d0-2ab1d3c3d712'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:13:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:13:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:13:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:13:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:13:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:13:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:13:59 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:13:59 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:00 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.160s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:00 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:14:00 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3682bb92-18c4-46fb-bec8-99af60cc4cf1 tempest-GroupsV320Test-1871072335 None] Delete group completed successfully. Jun 23 20:14:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Acquiring lock "cinder-aab858ff-fe54-456a-bf1d-236be1d8e459-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:14:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Lock "cinder-aab858ff-fe54-456a-bf1d-236be1d8e459-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:14:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Acquiring lock "cinder-quobyte-aab858ff-fe54-456a-bf1d-236be1d8e459" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:14:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Lock "cinder-quobyte-aab858ff-fe54-456a-bf1d-236be1d8e459" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:14:08 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c7f9d0-2f3b-4909-be71-dca0e5e894e6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:14:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:08 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 Jun 23 20:14:08 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:10 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459" returned: 0 in 1.469s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:10 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459 Jun 23 20:14:10 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:11 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-aab858ff-fe54-456a-bf1d-236be1d8e459" returned: 0 in 1.477s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Lock "cinder-quobyte-aab858ff-fe54-456a-bf1d-236be1d8e459" released by "delete_volume" :: held 3.033s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:14:11 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Created reservations ['1f31f825-d965-4df9-bb9d-e02d5c08151f', '3c2cb8e5-6f0c-48d4-a0bc-9923460a5b4a', '30cbbc2e-8f72-4b4e-bf24-60a1340adbf9', 'f825e129-941b-48b7-b302-778e87dea90c'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:14:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:14:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:14:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:12 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:14:12 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:13 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.411s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:13 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:14:13 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Deleted volume successfully. Jun 23 20:14:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dcb8cb5e-974b-45a7-8b2b-c3d89e6d2d7a tempest-TaggedAttachmentsTest-1312262594 None] Lock "cinder-aab858ff-fe54-456a-bf1d-236be1d8e459-delete_volume" released by "delete_volume" :: held 5.045s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:14:21 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=13,cinder:DELETE=1,cinder:SELECT=10,cinder:INSERT=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:14:23 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=16,cinder:SELECT=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Flow 'volume_create_manager' (c01a1041-a2a5-457d-8924-f2e095c60197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d758210-bffb-4edc-8c9e-19c3ff0352fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d758210-bffb-4edc-8c9e-19c3ff0352fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-694587264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ceb1ed-2680-4044-abad-65eee737dc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbe0793fd7a489b88f90b0fb412807c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:14:26Z,use_quota=True,user_id='804bad79b6c34677bd4c2d4933fc8b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541097d2-3526-4341-84c6-4b101a9f25ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541097d2-3526-4341-84c6-4b101a9f25ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c96ce8-b4b4-4633-bc11-17abffb2b8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c96ce8-b4b4-4633-bc11-17abffb2b8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ceb1ed-2680-4044-abad-65eee737dc9c', 'volume_name': 'volume-f4ceb1ed-2680-4044-abad-65eee737dc9c', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a2a999-bb1c-4cd3-98b2-b368630ae6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a2a999-bb1c-4cd3-98b2-b368630ae6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f5e238-ac18-4f9e-9279-a0e0090a6d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:25 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Volume f4ceb1ed-2680-4044-abad-65eee737dc9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ceb1ed-2680-4044-abad-65eee737dc9c', 'volume_size': 1} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-694587264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ceb1ed-2680-4044-abad-65eee737dc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbe0793fd7a489b88f90b0fb412807c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:14:26Z,use_quota=True,user_id='804bad79b6c34677bd4c2d4933fc8b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Creating volume f4ceb1ed-2680-4044-abad-65eee737dc9c {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:14:25 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:14:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:25 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c 1073741824 Jun 23 20:14:25 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:27 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c 1073741824" returned: 0 in 1.720s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:27 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c Jun 23 20:14:27 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:29 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c" returned: 0 in 1.280s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] <== create_volume: return (3166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:14:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.172s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f5e238-ac18-4f9e-9279-a0e0090a6d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ceb1ed-2680-4044-abad-65eee737dc9c', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5df61a-0966-4446-850a-17d2db1decab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:29 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Volume volume-f4ceb1ed-2680-4044-abad-65eee737dc9c (f4ceb1ed-2680-4044-abad-65eee737dc9c): created successfully Jun 23 20:14:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5df61a-0966-4446-850a-17d2db1decab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Flow 'volume_create_manager' (c01a1041-a2a5-457d-8924-f2e095c60197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:14:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-daa09a63-2d03-49cd-9912-37e483fc4ba4 tempest-ServerRescueNegativeTestJSON-1012894207 None] Created volume successfully. Jun 23 20:14:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7334e985-b142-4a80-9f67-ea60bdea3978 tempest-GroupSnapshotsTest-1034091370 None] Group tempest-GroupSnapshotsTest-Group-1362309189: creating Jun 23 20:14:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7334e985-b142-4a80-9f67-ea60bdea3978 tempest-GroupSnapshotsTest-1034091370 None] Group tempest-GroupSnapshotsTest-Group-1362309189: created successfully Jun 23 20:14:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7334e985-b142-4a80-9f67-ea60bdea3978 tempest-GroupSnapshotsTest-1034091370 None] Create group completed successfully. Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Flow 'volume_create_manager' (a6dfee4e-f3f7-457f-ae59-a45d77007a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce10a54d-9532-43f6-8584-d7867a82b0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce10a54d-9532-43f6-8584-d7867a82b0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-612388732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9237469d-6ed2-43b7-a7f2-14c9ba91a0ad,host='devstack@QuobyteHD#QuobyteHD',id=4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a63787e6c247a8ab6fc03dfa1e72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:14:34Z,use_quota=True,user_id='2c30f411b03f43218ce403b7780a28c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d108ba0-8e94-4945-9f41-fcaf524f9252),volume_type_id=5d108ba0-8e94-4945-9f41-fcaf524f9252)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c25678-4985-4b0c-aea7-909a7ec27e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c25678-4985-4b0c-aea7-909a7ec27e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bef0bc-f463-4336-90ba-b37bbc324a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bef0bc-f463-4336-90ba-b37bbc324a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13', 'volume_name': 'volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309528ba-c113-4f0d-87ea-80762b1f3ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309528ba-c113-4f0d-87ea-80762b1f3ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd479c1d-4d43-420e-b364-9cbcdab1dd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Volume 4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13', 'volume_size': 1} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9237469d-6ed2-43b7-a7f2-14c9ba91a0ad,created_at=2026-06-23T18:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-612388732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9237469d-6ed2-43b7-a7f2-14c9ba91a0ad,host='devstack@QuobyteHD#QuobyteHD',id=4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a63787e6c247a8ab6fc03dfa1e72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:14:34Z,use_quota=True,user_id='2c30f411b03f43218ce403b7780a28c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d108ba0-8e94-4945-9f41-fcaf524f9252),volume_type_id=5d108ba0-8e94-4945-9f41-fcaf524f9252)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Creating volume 4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:14:34 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:14:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:34 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 1073741824 Jun 23 20:14:34 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 1073741824" returned: 0 in 1.665s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:35 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:36 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 Jun 23 20:14:36 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:37 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" returned: 0 in 1.054s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] <== create_volume: return (2830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:14:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.832s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd479c1d-4d43-420e-b364-9cbcdab1dd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe6e446-f472-4092-aa92-cfafdfe12c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:14:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Volume volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 (4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13): created successfully Jun 23 20:14:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe6e446-f472-4092-aa92-cfafdfe12c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:14:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Flow 'volume_create_manager' (a6dfee4e-f3f7-457f-ae59-a45d77007a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:14:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-aed6038f-c7b7-4161-82e8-1af40d75378f tempest-GroupSnapshotsTest-1034091370 None] Created volume successfully. Jun 23 20:14:38 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] GroupSnapshot 1051ab41-0cc3-4891-aeef-1b10dfe71726: creating. Jun 23 20:14:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Group snapshot 1051ab41-0cc3-4891-aeef-1b10dfe71726: creating. {{(pid=93739) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 20:14:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Creating offline snapshot 746ca607-dc36-41dd-a0de-400c6236a0af of volume 4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:14:38 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e47e8c3-46d7-4fc5-a342-f06b91b823af]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:14:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:38 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 Jun 23 20:14:38 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:39 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" returned: 0 in 0.747s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:39 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af 1G Jun 23 20:14:39 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:40 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af 1G" returned: 0 in 0.833s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:40 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af Jun 23 20:14:40 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:40 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af" returned: 0 in 0.747s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:40 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:14:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:40 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af Jun 23 20:14:40 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:41 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af" returned: 0 in 1.026s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:42 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.info Jun 23 20:14:42 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:42 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.info" returned: 0 in 0.782s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:42 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:14:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:42 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.info Jun 23 20:14:42 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:43 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.info" returned: 0 in 0.726s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.972s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e33da7bb-eeaf-41c3-93ca-96d0b3e4e1df tempest-GroupSnapshotsTest-1034091370 None] group_snapshot 1051ab41-0cc3-4891-aeef-1b10dfe71726: created successfully Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-746ca607-dc36-41dd-a0de-400c6236a0af-fade5c5f-a896-49d8-83ec-5608d5df9e01" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-746ca607-dc36-41dd-a0de-400c6236a0af-fade5c5f-a896-49d8-83ec-5608d5df9e01" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Creating volume fade5c5f-a896-49d8-83ec-5608d5df9e01 from snapshot 746ca607-dc36-41dd-a0de-400c6236a0af {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-fade5c5f-a896-49d8-83ec-5608d5df9e01" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-fade5c5f-a896-49d8-83ec-5608d5df9e01" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:14:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] snapshot: 746ca607-dc36-41dd-a0de-400c6236a0af, volume: fade5c5f-a896-49d8-83ec-5608d5df9e01, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[471327fa-5e07-491f-bf60-0bc8fb1585b5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:46 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af Jun 23 20:14:46 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:46 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:14:46 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:47 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.771s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 8 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:14:47 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af" returned: 0 in 1.498s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c955320b-7a21-477e-81d8-708bfa8a9299]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:14:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:47 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 Jun 23 20:14:47 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:48 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" returned: 0 in 1.203s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:48 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:14:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:48 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 Jun 23 20:14:48 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-418e7b63-3091-4e48-9c8a-14223adc55c7 req-a10604ba-f123-4107-8ca2-1fc2da6148b7 tempest-ServerActionsTestOtherA-1591604329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Acquiring lock "cinder-f4ceb1ed-2680-4044-abad-65eee737dc9c-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:14:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "cinder-f4ceb1ed-2680-4044-abad-65eee737dc9c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:14:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Acquiring lock "cinder-quobyte-f4ceb1ed-2680-4044-abad-65eee737dc9c" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:14:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "cinder-quobyte-f4ceb1ed-2680-4044-abad-65eee737dc9c" acquired by "delete_volume" :: waited 0.033s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:14:55 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a831418f-2aa2-4b4c-9fb1-38924c9dfa4b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:14:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:55 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c Jun 23 20:14:55 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:57 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01" returned: 0 in 8.852s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:57 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddeeb13-d5e5-4a9c-aeb0-fa2947b3a797]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:14:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:57 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c" returned: 0 in 2.434s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:57 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c Jun 23 20:14:57 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:57 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 Jun 23 20:14:57 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:58 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4ceb1ed-2680-4044-abad-65eee737dc9c" returned: 0 in 0.900s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "cinder-quobyte-f4ceb1ed-2680-4044-abad-65eee737dc9c" released by "delete_volume" :: held 3.461s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Created reservations ['7c976ae3-db8a-4d13-aab4-10edd4ac003c', '15cec0a9-87bf-48c1-abd7-906847f7ce59', '083e8263-4899-4078-92ad-9e405f184ae9', '25bf7dc6-cf19-4b62-a798-8747db744848'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:14:58 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" returned: 0 in 1.186s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13, size 1024.00 MB, duration 8.85 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:14:58 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Converted 1024.00 MB image at 115.66 MB/s Jun 23 20:14:58 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:14:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:14:58 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:14:58 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:58 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 Jun 23 20:14:58 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:14:59 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.741s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:14:59 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Deleted volume successfully. Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ba028508-7f80-4164-9f1f-f98a79680238 tempest-ServerRescueNegativeTestJSON-1012894207 None] Lock "cinder-f4ceb1ed-2680-4044-abad-65eee737dc9c-delete_volume" released by "delete_volume" :: held 4.579s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:14:59 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01" returned: 0 in 0.877s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-fade5c5f-a896-49d8-83ec-5608d5df9e01" released by "_copy_volume_from_snapshot" :: held 13.856s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-746ca607-dc36-41dd-a0de-400c6236a0af-fade5c5f-a896-49d8-83ec-5608d5df9e01" released by "_create_volume_from_snapshot" :: held 13.934s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.980s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-418e7b63-3091-4e48-9c8a-14223adc55c7 req-a10604ba-f123-4107-8ca2-1fc2da6148b7 tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.225s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[da42c8f7-cdaa-4e6d-b77a-0e9e6291d01e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:14:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-418e7b63-3091-4e48-9c8a-14223adc55c7 req-a10604ba-f123-4107-8ca2-1fc2da6148b7 tempest-ServerActionsTestOtherA-1591604329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:00 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-63945630-ebeb-4bd5-a418-1dde5bc29e62 tempest-GroupSnapshotsTest-1034091370 None] Create group from source-snapshot-1051ab41-0cc3-4891-aeef-1b10dfe71726 completed successfully. Jun 23 20:15:00 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b Jun 23 20:15:00 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Flow 'volume_create_manager' (a6ba09fd-f8e6-46bb-85a9-5c209b469cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c980fa3-75fa-4fb6-b7ba-f21a9f098751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c980fa3-75fa-4fb6-b7ba-f21a9f098751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-804789578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671fe1e9-7c95-459d-843b-1d1da09c105e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3691ef5cf34aa68aa139bbbb01264a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:00Z,use_quota=True,user_id='88716f9385e841a9a1dafea7ac1c0ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81feda7e-73cd-4cfc-9005-28a31d1ef21a),volume_type_id=81feda7e-73cd-4cfc-9005-28a31d1ef21a)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aad4838-5c72-4f8e-92a8-500f5ab77971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aad4838-5c72-4f8e-92a8-500f5ab77971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634e71f8-aa9c-47f0-aa70-d2a17e43ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634e71f8-aa9c-47f0-aa70-d2a17e43ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671fe1e9-7c95-459d-843b-1d1da09c105e', 'volume_name': 'volume-671fe1e9-7c95-459d-843b-1d1da09c105e', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d5106c-aeeb-46c9-b7b0-dbb86a82eb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d5106c-aeeb-46c9-b7b0-dbb86a82eb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59014b4c-03e6-4e83-86ef-414112e587e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:00 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Volume 671fe1e9-7c95-459d-843b-1d1da09c105e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671fe1e9-7c95-459d-843b-1d1da09c105e', 'volume_size': 1} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:00 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-418e7b63-3091-4e48-9c8a-14223adc55c7 req-a10604ba-f123-4107-8ca2-1fc2da6148b7 tempest-ServerActionsTestOtherA-1591604329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b" returned: 0 in 0.985s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-418e7b63-3091-4e48-9c8a-14223adc55c7 req-a10604ba-f123-4107-8ca2-1fc2da6148b7 tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.197s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-804789578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671fe1e9-7c95-459d-843b-1d1da09c105e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3691ef5cf34aa68aa139bbbb01264a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:00Z,use_quota=True,user_id='88716f9385e841a9a1dafea7ac1c0ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81feda7e-73cd-4cfc-9005-28a31d1ef21a),volume_type_id=81feda7e-73cd-4cfc-9005-28a31d1ef21a)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Creating volume 671fe1e9-7c95-459d-843b-1d1da09c105e {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:15:00 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:00 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e 1073741824 Jun 23 20:15:00 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-418e7b63-3091-4e48-9c8a-14223adc55c7 req-a10604ba-f123-4107-8ca2-1fc2da6148b7 tempest-ServerActionsTestOtherA-1591604329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-989dead4-89d9-4e31-89aa-7bd507f8c53b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '710630cd-0ebd-4d89-8b07-a56e74ace9fa', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:15:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-418e7b63-3091-4e48-9c8a-14223adc55c7 req-a10604ba-f123-4107-8ca2-1fc2da6148b7 tempest-ServerActionsTestOtherA-1591604329 None] attachment_update completed successfully. Jun 23 20:15:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-fade5c5f-a896-49d8-83ec-5608d5df9e01" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-fade5c5f-a896-49d8-83ec-5608d5df9e01" acquired by "delete_volume" :: waited 0.045s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:01 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8a531-5ec5-4867-8ab6-c50271f3d07b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:02 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 Jun 23 20:15:02 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:02 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e 1073741824" returned: 0 in 1.671s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:02 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e Jun 23 20:15:02 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:03 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01" returned: 0 in 1.554s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:03 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01 Jun 23 20:15:03 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:03 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e" returned: 0 in 1.060s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] <== create_volume: return (2830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.833s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59014b4c-03e6-4e83-86ef-414112e587e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671fe1e9-7c95-459d-843b-1d1da09c105e', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbce2b12-576c-4b0f-a1ad-ca5d595ecf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:03 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Volume volume-671fe1e9-7c95-459d-843b-1d1da09c105e (671fe1e9-7c95-459d-843b-1d1da09c105e): created successfully Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbce2b12-576c-4b0f-a1ad-ca5d595ecf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Flow 'volume_create_manager' (a6ba09fd-f8e6-46bb-85a9-5c209b469cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:03 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3b4eb5ec-3e25-4939-93fb-1892dd3fbeaf tempest-VolumeTypesAccessTest-1693457532 None] Created volume successfully. Jun 23 20:15:04 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fade5c5f-a896-49d8-83ec-5608d5df9e01" returned: 0 in 0.922s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-fade5c5f-a896-49d8-83ec-5608d5df9e01" released by "delete_volume" :: held 2.534s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['fb4eb1e9-3d24-4744-8673-c13c661db773'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:04 devstack cinder-volume[93739]: WARNING cinder.quota [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-291195390 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-291195390, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:15:04 devstack cinder-volume[93739]: WARNING cinder.quota [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-291195390 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-291195390, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['be023f26-f441-4ad8-8cb2-7a67ded6b0ec', '176aa326-4d6b-469a-bca9-210634683a51', '6f29fd2f-35eb-4163-ac28-63d47d94cb5f', '9627332d-e495-4853-98ca-1b795864e3a0'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:04 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:15:04 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Acquiring lock "cinder-671fe1e9-7c95-459d-843b-1d1da09c105e-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Lock "cinder-671fe1e9-7c95-459d-843b-1d1da09c105e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Acquiring lock "cinder-quobyte-671fe1e9-7c95-459d-843b-1d1da09c105e" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Lock "cinder-quobyte-671fe1e9-7c95-459d-843b-1d1da09c105e" acquired by "delete_volume" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf8646-02b2-45dd-9ee3-54d34d42f1fb]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:05 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e Jun 23 20:15:05 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:05 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.681s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:15:05 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-55c69f13-57f8-475f-94b3-e506591a49cb tempest-GroupSnapshotsTest-1034091370 None] Delete group completed successfully. Jun 23 20:15:05 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] group_snapshot 1051ab41-0cc3-4891-aeef-1b10dfe71726: deleting Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] group_snapshot 1051ab41-0cc3-4891-aeef-1b10dfe71726: deleting {{(pid=93739) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-746ca607-dc36-41dd-a0de-400c6236a0af" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-746ca607-dc36-41dd-a0de-400c6236a0af" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Deleting offline snapshot 746ca607-dc36-41dd-a0de-400c6236a0af of volume 4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] snapshot_file for this snap is: volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[18903b70-898b-49b2-9d6d-75dfeaf71c61]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:05 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e" returned: 0 in 0.859s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:05 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e Jun 23 20:15:05 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:05 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af Jun 23 20:15:05 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:06 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-671fe1e9-7c95-459d-843b-1d1da09c105e" returned: 0 in 0.678s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Lock "cinder-quobyte-671fe1e9-7c95-459d-843b-1d1da09c105e" released by "delete_volume" :: held 1.589s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:06 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af" returned: 0 in 0.776s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:15:06 devstack cinder-volume[93739]: WARNING cinder.quota [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-701359450 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-701359450, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:15:06 devstack cinder-volume[93739]: WARNING cinder.quota [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-701359450 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-701359450, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d18357f-2400-44de-8aa0-6d200d4c9a5f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Created reservations ['276e05e1-fb07-49cd-9c29-e4d719f05aba', '00b0f84b-5b6f-4d69-bbff-5fcf630dbc55', '6155dd84-700b-47aa-bd54-3d89703846ee', '5d335ec2-b840-42eb-9a58-3dcfe5ab6c13'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:06 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 Jun 23 20:15:06 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:06 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:15:06 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:07 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.758s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:07 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:15:07 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Deleted volume successfully. Jun 23 20:15:07 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" returned: 0 in 0.927s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3f9fc86-0ea3-4487-971a-758b6f134856 tempest-VolumeTypesAccessTest-1693457532 None] Lock "cinder-671fe1e9-7c95-459d-843b-1d1da09c105e-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:07 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af Jun 23 20:15:07 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:08 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af" returned: 0 in 0.858s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:08 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af Jun 23 20:15:08 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:09 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13.746ca607-dc36-41dd-a0de-400c6236a0af" returned: 0 in 0.743s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-746ca607-dc36-41dd-a0de-400c6236a0af" released by "_delete_snapshot" :: held 3.474s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" released by "delete_snapshot" :: held 3.512s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:09 devstack cinder-volume[93739]: WARNING cinder.quota [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-291195390 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-291195390, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:15:09 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['dba57bbc-a3a6-41f1-bd86-656c9cb6f34d', '0913f331-75a0-4b45-a4fd-12278eca7811', '7d0f6b44-d675-4f1d-8f36-170ac5144921', 'dfbe68a0-1b93-45f3-af75-7672c59c03b9'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:09 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-69e3bbed-1799-4f9f-915d-21bf3d1f006b tempest-GroupSnapshotsTest-1034091370 None] group_snapshot 1051ab41-0cc3-4891-aeef-1b10dfe71726: deleted successfully Jun 23 20:15:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-8721075b-c506-4253-9a87-0e7f2cceef0c tempest-ServerActionsTestOtherA-1591604329 None] Terminate volume connection completed successfully. Jun 23 20:15:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-8721075b-c506-4253-9a87-0e7f2cceef0c tempest-ServerActionsTestOtherA-1591604329 None] Deleting attachment 710630cd-0ebd-4d89-8b07-a56e74ace9fa. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:15:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" acquired by "delete_volume" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6a47b5-53dd-4c74-859a-282d458f9f80]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:10 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 Jun 23 20:15:10 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:11 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" returned: 0 in 1.032s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:11 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13 Jun 23 20:15:11 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:12 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" returned: 0 in 1.106s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-4bd63b7a-3cb9-4494-8bae-c56ea0aa4e13" released by "delete_volume" :: held 2.239s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['b7251bed-8e9b-41e4-8bc7-e3ca45ccb6e8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:13 devstack cinder-volume[93739]: WARNING cinder.db.api [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-291195390'] Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['7946c9e5-6a2a-4103-a166-d845106ac6c2', 'fe1bf0f8-280d-4eb7-bfff-a2fc84f5a3c9', '785ede67-064b-4474-b82f-84e3854c09fc', 'b047166e-778b-4bf8-ba54-b31a7e318dba'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-2f52367c-d79d-479e-97d2-5154f8d4207b tempest-ServerActionsTestOtherA-1591604329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-2f52367c-d79d-479e-97d2-5154f8d4207b tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[967d4b23-7ca9-421b-b4aa-eb7e408a3c46]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-2f52367c-d79d-479e-97d2-5154f8d4207b tempest-ServerActionsTestOtherA-1591604329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:13 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:15:13 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:13 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b Jun 23 20:15:13 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-998cbb88-4b73-4424-9ec1-4d1ceecd4741 tempest-GroupSnapshotsTest-1034091370 None] Group tempest-GroupSnapshotsTest-Group-329757522: creating Jun 23 20:15:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-998cbb88-4b73-4424-9ec1-4d1ceecd4741 tempest-GroupSnapshotsTest-1034091370 None] Group tempest-GroupSnapshotsTest-Group-329757522: created successfully Jun 23 20:15:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-998cbb88-4b73-4424-9ec1-4d1ceecd4741 tempest-GroupSnapshotsTest-1034091370 None] Create group completed successfully. Jun 23 20:15:14 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.009s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:14 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:15:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ca85dd3d-49b2-4435-8371-9a049a294246 tempest-GroupSnapshotsTest-1034091370 None] Delete group completed successfully. Jun 23 20:15:14 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-2f52367c-d79d-479e-97d2-5154f8d4207b tempest-ServerActionsTestOtherA-1591604329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b" returned: 0 in 1.111s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-2f52367c-d79d-479e-97d2-5154f8d4207b tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.136s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:14 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-2f52367c-d79d-479e-97d2-5154f8d4207b tempest-ServerActionsTestOtherA-1591604329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-989dead4-89d9-4e31-89aa-7bd507f8c53b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0e3ad32-e3fa-4f03-8e8e-10de744fd8ff', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:15:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-8144abdb-c5fc-4f98-8c94-22aa3604a463 req-2f52367c-d79d-479e-97d2-5154f8d4207b tempest-ServerActionsTestOtherA-1591604329 None] attachment_update completed successfully. Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Flow 'volume_create_manager' (7cc9df16-298b-4c29-913b-16a63e1fd9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b644c9fb-9b86-4aed-bb8a-f7c7e21e6a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b644c9fb-9b86-4aed-bb8a-f7c7e21e6a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-322654811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01c166fc-60cb-4468-aa8f-48a5ea1dffe7,host='devstack@QuobyteHD#QuobyteHD',id=940771aa-e5ef-4ead-a484-b0f29c99e38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a63787e6c247a8ab6fc03dfa1e72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:16Z,use_quota=True,user_id='2c30f411b03f43218ce403b7780a28c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc4ac976-8b07-4ce7-b025-16eb3926677f),volume_type_id=dc4ac976-8b07-4ce7-b025-16eb3926677f)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c5309d-2c63-45fc-9157-306eda452040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c5309d-2c63-45fc-9157-306eda452040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7aac678-d81f-4777-a62a-16c4b19a1b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7aac678-d81f-4777-a62a-16c4b19a1b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940771aa-e5ef-4ead-a484-b0f29c99e38b', 'volume_name': 'volume-940771aa-e5ef-4ead-a484-b0f29c99e38b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85946ec9-0eba-42da-a5b1-9dc77836f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85946ec9-0eba-42da-a5b1-9dc77836f05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beac88a5-f1d2-46fd-8ef2-ca98db9fdc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Volume 940771aa-e5ef-4ead-a484-b0f29c99e38b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940771aa-e5ef-4ead-a484-b0f29c99e38b', 'volume_size': 1} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=01c166fc-60cb-4468-aa8f-48a5ea1dffe7,created_at=2026-06-23T18:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-322654811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01c166fc-60cb-4468-aa8f-48a5ea1dffe7,host='devstack@QuobyteHD#QuobyteHD',id=940771aa-e5ef-4ead-a484-b0f29c99e38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a63787e6c247a8ab6fc03dfa1e72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:16Z,use_quota=True,user_id='2c30f411b03f43218ce403b7780a28c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc4ac976-8b07-4ce7-b025-16eb3926677f),volume_type_id=dc4ac976-8b07-4ce7-b025-16eb3926677f)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Creating volume 940771aa-e5ef-4ead-a484-b0f29c99e38b {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:15:15 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:15:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:15 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b 1073741824 Jun 23 20:15:15 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:16 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b 1073741824" returned: 0 in 0.930s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:16 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b Jun 23 20:15:16 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:17 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b" returned: 0 in 0.756s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:15:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beac88a5-f1d2-46fd-8ef2-ca98db9fdc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940771aa-e5ef-4ead-a484-b0f29c99e38b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead6ae5-8afe-4c2b-8442-9915021c1eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:17 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Volume volume-940771aa-e5ef-4ead-a484-b0f29c99e38b (940771aa-e5ef-4ead-a484-b0f29c99e38b): created successfully Jun 23 20:15:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead6ae5-8afe-4c2b-8442-9915021c1eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Flow 'volume_create_manager' (7cc9df16-298b-4c29-913b-16a63e1fd9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:17 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-623203ce-737f-46db-877b-bc694c39c1e6 tempest-GroupSnapshotsTest-1034091370 None] Created volume successfully. Jun 23 20:15:18 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:15:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Flow 'volume_create_manager' (3409eb18-f50a-422c-acf9-e1a8101dd721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d283c0f8-6449-445c-9a5c-591ccb1be27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d283c0f8-6449-445c-9a5c-591ccb1be27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860636745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01c166fc-60cb-4468-aa8f-48a5ea1dffe7,host='devstack@QuobyteHD#QuobyteHD',id=d34b3853-ef5d-4b77-ae26-e171fe0dbc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a63787e6c247a8ab6fc03dfa1e72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:19Z,use_quota=True,user_id='2c30f411b03f43218ce403b7780a28c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc4ac976-8b07-4ce7-b025-16eb3926677f),volume_type_id=dc4ac976-8b07-4ce7-b025-16eb3926677f)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecbe4ca-5c59-4ce6-8b39-da81f0d1559b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecbe4ca-5c59-4ce6-8b39-da81f0d1559b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf58289-234b-41c4-bf2a-07c41a1e6b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf58289-234b-41c4-bf2a-07c41a1e6b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34b3853-ef5d-4b77-ae26-e171fe0dbc83', 'volume_name': 'volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f53cc94-6145-40de-b1d8-59fc65c47c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f53cc94-6145-40de-b1d8-59fc65c47c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557f8a6e-0da8-44a9-9531-c84efee388f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:19 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Volume d34b3853-ef5d-4b77-ae26-e171fe0dbc83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83', 'volume_size': 1} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=01c166fc-60cb-4468-aa8f-48a5ea1dffe7,created_at=2026-06-23T18:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860636745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01c166fc-60cb-4468-aa8f-48a5ea1dffe7,host='devstack@QuobyteHD#QuobyteHD',id=d34b3853-ef5d-4b77-ae26-e171fe0dbc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a63787e6c247a8ab6fc03dfa1e72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:19Z,use_quota=True,user_id='2c30f411b03f43218ce403b7780a28c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc4ac976-8b07-4ce7-b025-16eb3926677f),volume_type_id=dc4ac976-8b07-4ce7-b025-16eb3926677f)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Creating volume d34b3853-ef5d-4b77-ae26-e171fe0dbc83 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:15:19 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:15:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:19 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 1073741824 Jun 23 20:15:19 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:20 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 1073741824" returned: 0 in 1.030s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:20 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 Jun 23 20:15:20 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:21 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" returned: 0 in 0.870s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:15:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557f8a6e-0da8-44a9-9531-c84efee388f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8333a487-9d42-4943-84d4-ad44aff2cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:21 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Volume volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 (d34b3853-ef5d-4b77-ae26-e171fe0dbc83): created successfully Jun 23 20:15:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8333a487-9d42-4943-84d4-ad44aff2cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Flow 'volume_create_manager' (3409eb18-f50a-422c-acf9-e1a8101dd721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0caa1fbe-147f-44af-a6ae-5339e837faf3 tempest-GroupSnapshotsTest-1034091370 None] Created volume successfully. Jun 23 20:15:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-47343b50-9330-45e7-9290-317f02da324b tempest-GroupSnapshotsTest-1034091370 None] Update group completed successfully. Jun 23 20:15:23 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=74,cinder:SELECT=71,cinder:DELETE=5,cinder:INSERT=11 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:15:23 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-902ad622-5ec6-4ccb-8e5c-a288f57db4f0 tempest-GroupSnapshotsTest-1034091370 None] Update group completed successfully. Jun 23 20:15:24 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=77,cinder:INSERT=17,cinder:UPDATE=63,cinder:DELETE=2 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:15:24 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-90962a08-b03c-4e8f-b24b-1ffa97614a4e tempest-GroupSnapshotsTest-1034091370 None] Update group completed successfully. Jun 23 20:15:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bba815bf-b157-47c0-a864-77c69401da0a tempest-GroupSnapshotsTest-1034091370 None] Update group completed successfully. Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Flow 'volume_create_manager' (cb80f9d3-3ba9-4004-98f5-b5ae06f039eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff882230-6290-467a-af8a-e8558f75fbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff882230-6290-467a-af8a-e8558f75fbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-983614178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e380d2d6-046d-43a9-bbab-583539572ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea15fad921465ba27eac0b20f33987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:27Z,use_quota=True,user_id='832f2a96d2f948fab1b2c85cb9ebe6c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da54094-b5a4-4635-886a-36626f7ffbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da54094-b5a4-4635-886a-36626f7ffbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46e99a-2e1b-4dc1-afa7-131cec628c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46e99a-2e1b-4dc1-afa7-131cec628c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e380d2d6-046d-43a9-bbab-583539572ca2', 'volume_name': 'volume-e380d2d6-046d-43a9-bbab-583539572ca2', 'volume_size': 2}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038f6ef1-986e-4e0d-8fe4-4ee90a00da9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038f6ef1-986e-4e0d-8fe4-4ee90a00da9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4fca39-c8f1-41a3-b80c-8298c0e0c244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:26 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Volume e380d2d6-046d-43a9-bbab-583539572ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e380d2d6-046d-43a9-bbab-583539572ca2', 'volume_size': 2} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-983614178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e380d2d6-046d-43a9-bbab-583539572ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea15fad921465ba27eac0b20f33987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:27Z,use_quota=True,user_id='832f2a96d2f948fab1b2c85cb9ebe6c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Creating volume e380d2d6-046d-43a9-bbab-583539572ca2 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:15:26 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:15:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 2147483648 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:26 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 2147483648 Jun 23 20:15:26 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:27 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] GroupSnapshot d1fed338-683f-4f9d-bbcd-c19faf3aaa40: creating. Jun 23 20:15:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Group snapshot d1fed338-683f-4f9d-bbcd-c19faf3aaa40: creating. {{(pid=93739) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 20:15:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:28 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 2147483648" returned: 0 in 1.163s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:28 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 Jun 23 20:15:28 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:28 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2" returned: 0 in 0.711s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.209s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Creating offline snapshot 9045ef71-1602-4c07-ab44-d642539e1771 of volume 940771aa-e5ef-4ead-a484-b0f29c99e38b {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4fca39-c8f1-41a3-b80c-8298c0e0c244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e380d2d6-046d-43a9-bbab-583539572ca2', 'volume_size': 2}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fdc604-825a-417b-ba46-13f745505516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba2a5ee-8e69-400b-b471-6ae85a5063d2]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:28 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Volume volume-e380d2d6-046d-43a9-bbab-583539572ca2 (e380d2d6-046d-43a9-bbab-583539572ca2): created successfully Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fdc604-825a-417b-ba46-13f745505516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Flow 'volume_create_manager' (cb80f9d3-3ba9-4004-98f5-b5ae06f039eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:28 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b05ad980-0cbb-41d8-adb2-8f1386f172c6 tempest-VolumesCloneNegativeTest-77899015 None] Created volume successfully. Jun 23 20:15:28 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b Jun 23 20:15:28 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:29 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b" returned: 0 in 0.869s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:29 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 1G Jun 23 20:15:29 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Acquiring lock "cinder-e380d2d6-046d-43a9-bbab-583539572ca2-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Lock "cinder-e380d2d6-046d-43a9-bbab-583539572ca2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Acquiring lock "cinder-quobyte-e380d2d6-046d-43a9-bbab-583539572ca2" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Lock "cinder-quobyte-e380d2d6-046d-43a9-bbab-583539572ca2" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:30 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b487a-866e-4f48-aee9-75f6f2ed621c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:30 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 Jun 23 20:15:30 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:30 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 1G" returned: 0 in 1.062s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-940771aa-e5ef-4ead-a484-b0f29c99e38b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:30 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-940771aa-e5ef-4ead-a484-b0f29c99e38b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 Jun 23 20:15:30 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:31 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2" returned: 0 in 1.433s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:31 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2 Jun 23 20:15:31 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:32 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-940771aa-e5ef-4ead-a484-b0f29c99e38b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771" returned: 0 in 1.432s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:32 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:32 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 Jun 23 20:15:32 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:32 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e380d2d6-046d-43a9-bbab-583539572ca2" returned: 0 in 0.883s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Lock "cinder-quobyte-e380d2d6-046d-43a9-bbab-583539572ca2" released by "delete_volume" :: held 2.366s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Created reservations ['f1e66435-14df-43f3-96f7-f9ff17077019', 'c53ed381-aa62-4dbc-a92f-4c5ee434a83b', '13c1b30a-22e7-4a93-a8b3-5a92d67c6775', 'b4699134-3b07-48ea-a04b-9bb8578f2e24'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:32 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:15:32 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:33 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771" returned: 0 in 0.885s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:33 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.info Jun 23 20:15:33 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:33 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.056s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:33 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:15:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Deleted volume successfully. Jun 23 20:15:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-10a147ab-2acb-4a80-9197-db4b23d7654a tempest-VolumesCloneNegativeTest-77899015 None] Lock "cinder-e380d2d6-046d-43a9-bbab-583539572ca2-delete_volume" released by "delete_volume" :: held 3.829s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:34 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.info" returned: 0 in 1.114s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:34 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:15:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:34 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.info Jun 23 20:15:34 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:35 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.info" returned: 0 in 0.899s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.401s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Creating offline snapshot ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 of volume d34b3853-ef5d-4b77-ae26-e171fe0dbc83 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:15:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[05185cad-395c-47af-ba9e-ff15bb8e6afe]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:35 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 Jun 23 20:15:35 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:36 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" returned: 0 in 1.066s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:36 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 1G Jun 23 20:15:36 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:37 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 1G" returned: 0 in 0.961s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:37 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 Jun 23 20:15:37 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:38 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9" returned: 0 in 0.869s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:38 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:38 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 Jun 23 20:15:38 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Flow 'volume_create_manager' (49be3d12-d587-469c-b232-048a9cab45c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910e728d-cd2c-4c8a-b30a-78da11bb30e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910e728d-cd2c-4c8a-b30a-78da11bb30e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1379988996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2aecaaf-6f07-455b-94ae-470eb3af3f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ea53678e04b4ba144279b521d6e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:38Z,use_quota=True,user_id='b131cb9d0e044dd1abc9b0aa5a5915d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9817b2c-2ba6-4ce4-8dae-1df417892cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9817b2c-2ba6-4ce4-8dae-1df417892cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950cc18f-cc64-4f6d-8851-b17658f74a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:15:38 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9" returned: 0 in 0.767s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:38 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.info Jun 23 20:15:38 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950cc18f-cc64-4f6d-8851-b17658f74a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2aecaaf-6f07-455b-94ae-470eb3af3f47', 'volume_name': 'volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6165c77b-a7c9-4ca1-8020-50aa42689b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6165c77b-a7c9-4ca1-8020-50aa42689b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf624f8-7d4c-4b60-bb86-245f1da8582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:39 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Volume c2aecaaf-6f07-455b-94ae-470eb3af3f47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Trying to clone c2aecaaf-6f07-455b-94ae-470eb3af3f47 from image 8123ebb9-f4e0-4d01-974c-3920c780745e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:15:39 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Image download 20.69 MB at 20.69 MB/s Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[801093b3-009a-4cd1-a6a4-ece5a37474d7]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:39 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD Jun 23 20:15:39 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:39 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.info" returned: 0 in 0.735s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:39 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:15:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:39 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.info Jun 23 20:15:39 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:40 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:40 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Temporary image 8123ebb9-f4e0-4d01-974c-3920c780745e is fetched for user b131cb9d0e044dd1abc9b0aa5a5915d9. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:15:40 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b803c05d-4092-4ba0-bfb5-901b297b13ca]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:40 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.info" returned: 0 in 0.708s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:40 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD Jun 23 20:15:40 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.225s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9785352b-fd10-4731-b7b8-6427d412bc1a tempest-GroupSnapshotsTest-1034091370 None] group_snapshot d1fed338-683f-4f9d-bbcd-c19faf3aaa40: created successfully Jun 23 20:15:41 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1379988996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2aecaaf-6f07-455b-94ae-470eb3af3f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ea53678e04b4ba144279b521d6e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:15:38Z,use_quota=True,user_id='b131cb9d0e044dd1abc9b0aa5a5915d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Creating volume c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:15:41 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:41 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 1073741824 Jun 23 20:15:41 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:41 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] group_snapshot d1fed338-683f-4f9d-bbcd-c19faf3aaa40: deleting Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] group_snapshot d1fed338-683f-4f9d-bbcd-c19faf3aaa40: deleting {{(pid=93739) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-940771aa-e5ef-4ead-a484-b0f29c99e38b" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-940771aa-e5ef-4ead-a484-b0f29c99e38b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-9045ef71-1602-4c07-ab44-d642539e1771" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-9045ef71-1602-4c07-ab44-d642539e1771" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Deleting offline snapshot 9045ef71-1602-4c07-ab44-d642539e1771 of volume 940771aa-e5ef-4ead-a484-b0f29c99e38b {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] snapshot_file for this snap is: volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4e13de-c22f-434e-b4ac-01b6a09e45a9]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:41 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 Jun 23 20:15:41 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:41 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 1073741824" returned: 0 in 0.897s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:42 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:42 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:42 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771" returned: 0 in 0.789s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-940771aa-e5ef-4ead-a484-b0f29c99e38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee88e39-d594-45e8-8cda-6cb309e04098]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:42 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 0 in 0.623s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Attempting download of 8123ebb9-f4e0-4d01-974c-3920c780745e ((None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}])) to volume c2aecaaf-6f07-455b-94ae-470eb3af3f47. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0c494e-a664-4707-a833-f8ed9a920100]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_burvv9dv {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:42 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b Jun 23 20:15:42 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:42 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_burvv9dv Jun 23 20:15:42 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:43 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b" returned: 0 in 0.972s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:43 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_burvv9dv" returned: 0 in 0.896s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_burvv9dv {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:43 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 Jun 23 20:15:43 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:43 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_burvv9dv Jun 23 20:15:43 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:44 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771" returned: 0 in 0.763s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:44 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771 Jun 23 20:15:44 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:44 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_burvv9dv" returned: 1 in 0.766s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_burvv9dv' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:15:44 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57323b3-bab8-49fb-94f4-f4473954b352]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:44 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD Jun 23 20:15:44 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:45 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b.9045ef71-1602-4c07-ab44-d642539e1771" returned: 0 in 0.879s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-9045ef71-1602-4c07-ab44-d642539e1771" released by "_delete_snapshot" :: held 3.534s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-940771aa-e5ef-4ead-a484-b0f29c99e38b" released by "delete_snapshot" :: held 3.568s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Deleting offline snapshot ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 of volume d34b3853-ef5d-4b77-ae26-e171fe0dbc83 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:15:45 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] snapshot_file for this snap is: volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD" returned: 0 in 0.983s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] 8123ebb9-f4e0-4d01-974c-3920c780745e was qcow2, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb53ad4-8691-47e7-997d-5aaabd92e8c1]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:45 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:45 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:45 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 Jun 23 20:15:45 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:46 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9" returned: 0 in 1.049s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba266b3-3dac-4cfa-9def-cdf9b630b341]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:46 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 Jun 23 20:15:46 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:46 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:15:46 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:47 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" returned: 0 in 1.244s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:47 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.086s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:15:47 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 Jun 23 20:15:47 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:47 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 0 in 2.542s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_g1o2qaoedevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:15:47 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Converted 112.00 MB image at 44.03 MB/s Jun 23 20:15:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:47 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 1G Jun 23 20:15:47 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:48 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-b92d3bb6-1bd9-4d82-b7f2-151773fe96e8 req-34e26ec6-8793-4ef9-91e0-f9c9b4c99f47 tempest-ServerActionsTestOtherA-1591604329 None] Terminate volume connection completed successfully. Jun 23 20:15:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-b92d3bb6-1bd9-4d82-b7f2-151773fe96e8 req-34e26ec6-8793-4ef9-91e0-f9c9b4c99f47 tempest-ServerActionsTestOtherA-1591604329 None] Deleting attachment b0e3ad32-e3fa-4f03-8e8e-10de744fd8ff. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:15:48 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9" returned: 0 in 0.836s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:48 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9 Jun 23 20:15:48 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:48 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 1G" returned: 0 in 0.749s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:48 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[55298dd8-0aa4-45b0-ae1a-8509d534751f]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:48 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:48 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:49 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83.ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9" returned: 0 in 0.707s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-ff69ddc4-1c7c-4cd0-a2b0-7839bf2207b9" released by "_delete_snapshot" :: held 3.990s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" released by "delete_snapshot" :: held 4.017s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:49 devstack cinder-volume[93739]: WARNING cinder.quota [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-169629732 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-169629732, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:15:49 devstack cinder-volume[93739]: WARNING cinder.quota [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-169629732 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-169629732, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:15:49 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['5e9c5f44-eb4d-4519-ab75-f1cd22dff646', '904642cf-ca8d-43e5-905e-b480c3dc8cca', 'd513d989-e049-405e-95a4-fe24af8568c9', '7e87f1fc-7ee2-4a94-a7d0-5c7cde613e1a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:49 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 0 in 0.791s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:49 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['6a789c87-f8d8-4824-bd2f-d37a717220b7', '2a1a3177-ecab-40ad-8798-03a8e402cb0e', 'e338d138-bcd5-4954-a3cd-64991206136d', '43894189-b037-456d-8c9a-69b48ca6db24'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:49 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:49 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2a966dc2-7af6-43c7-826a-3274a8e5704f tempest-GroupSnapshotsTest-1034091370 None] group_snapshot d1fed338-683f-4f9d-bbcd-c19faf3aaa40: deleted successfully Jun 23 20:15:50 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 1 in 0.770s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Downloaded image 8123ebb9-f4e0-4d01-974c-3920c780745e ((None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}])) to volume c2aecaaf-6f07-455b-94ae-470eb3af3f47 successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Temporary image 8123ebb9-f4e0-4d01-974c-3920c780745e for user b131cb9d0e044dd1abc9b0aa5a5915d9 is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Marking volume c2aecaaf-6f07-455b-94ae-470eb3af3f47 as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Copying metadata from image 8123ebb9-f4e0-4d01-974c-3920c780745e to c2aecaaf-6f07-455b-94ae-470eb3af3f47. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Creating volume glance metadata for volume c2aecaaf-6f07-455b-94ae-470eb3af3f47 backed by image 8123ebb9-f4e0-4d01-974c-3920c780745e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf624f8-7d4c-4b60-bb86-245f1da8582f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6caf93f8-ad3f-4723-b935-dc78e12024f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:15:50 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Volume volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 (c2aecaaf-6f07-455b-94ae-470eb3af3f47): created successfully Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6caf93f8-ad3f-4723-b935-dc78e12024f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Flow 'volume_create_manager' (49be3d12-d587-469c-b232-048a9cab45c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:15:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c5b1287e-4ba2-4b08-962c-834632204d5a tempest-VolumesExtendTest-1944450026 None] Created volume successfully. Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-940771aa-e5ef-4ead-a484-b0f29c99e38b" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-940771aa-e5ef-4ead-a484-b0f29c99e38b" acquired by "delete_volume" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc7945-22d4-4adf-ae53-f162875bac28]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:51 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b Jun 23 20:15:51 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:51 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e086c-5e66-49f7-8b53-0a503adf4126]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:51 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:51 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:51 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b" returned: 0 in 0.973s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:51 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b Jun 23 20:15:51 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:52 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 0 in 1.265s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:53 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:53 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:53 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-940771aa-e5ef-4ead-a484-b0f29c99e38b" returned: 0 in 1.155s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-940771aa-e5ef-4ead-a484-b0f29c99e38b" released by "delete_volume" :: held 2.250s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" acquired by "delete_volume" :: waited 0.035s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:53 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef07cfbc-c363-4557-8301-7bfd04cce4ea]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:53 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 Jun 23 20:15:53 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:54 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 1 in 1.743s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:15:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 2G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 2G" returned: 0 in 0.145s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.211s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:54 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" returned: 0 in 1.588s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:54 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83 Jun 23 20:15:54 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0f363638-bdb4-4452-9349-6e6f2e628aaa tempest-VolumesExtendTest-1944450026 None] Extend volume completed successfully. Jun 23 20:15:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Acquiring lock "cinder-c2aecaaf-6f07-455b-94ae-470eb3af3f47-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Lock "cinder-c2aecaaf-6f07-455b-94ae-470eb3af3f47-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Acquiring lock "cinder-quobyte-c2aecaaf-6f07-455b-94ae-470eb3af3f47" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:15:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Lock "cinder-quobyte-c2aecaaf-6f07-455b-94ae-470eb3af3f47" acquired by "delete_volume" :: waited 0.052s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:15:55 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0859bc-6409-40c5-a6ec-7d98f41cfdc0]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:15:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:55 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:55 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:55 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" returned: 0 in 1.076s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-d34b3853-ef5d-4b77-ae26-e171fe0dbc83" released by "delete_volume" :: held 2.768s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['61f7e6e9-8f1d-42d5-96d6-2179a28b8370'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:56 devstack cinder-volume[93739]: WARNING cinder.quota [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-169629732 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-169629732, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['1674c24a-2f3b-4cf1-836f-437c64a705a2', 'd340f3ca-1160-42ae-b794-1a7968e5fc84', '6b106570-e8c9-40a9-8ee6-c906e6333866', '841d2d14-6bd6-4812-b4e5-70bbf025f24e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['6c29e7a4-d7cf-408b-9312-523c01e6de30', '4d8cd6b0-abb6-416b-9298-15d8019891f1', '328b08cb-cd3d-4ff2-8e0d-504e8bc60455', '2b16aaa2-ce9b-451a-93e6-c8462f7d020b'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:56 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:15:56 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:56 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 0 in 1.235s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:57 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:57 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:57 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.331s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:57 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:15:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-57aebbce-5edf-468c-96c7-48afe662e3bf tempest-GroupSnapshotsTest-1034091370 None] Delete group completed successfully. Jun 23 20:15:58 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 1 in 1.173s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:15:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:58 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47 Jun 23 20:15:58 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:15:58 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1c784d42-e3c0-441d-86a8-3315701fd76d tempest-GroupSnapshotsTest-1034091370 None] Group tempest-GroupSnapshotsTest-Group-874281614: creating Jun 23 20:15:58 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1c784d42-e3c0-441d-86a8-3315701fd76d tempest-GroupSnapshotsTest-1034091370 None] Group tempest-GroupSnapshotsTest-Group-874281614: created successfully Jun 23 20:15:58 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1c784d42-e3c0-441d-86a8-3315701fd76d tempest-GroupSnapshotsTest-1034091370 None] Create group completed successfully. Jun 23 20:15:59 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c2aecaaf-6f07-455b-94ae-470eb3af3f47" returned: 0 in 1.021s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Lock "cinder-quobyte-c2aecaaf-6f07-455b-94ae-470eb3af3f47" released by "delete_volume" :: held 3.569s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Created reservations ['9a6ba216-6fc8-46b4-89bc-92e0618fe515', 'cc994740-0c63-4017-ae94-d6c42a1440ba', '559972b4-0d92-4010-bca4-bfa5596765f0', '1196c0f8-85b6-42ab-811b-13cb00f800b2'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:15:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:15:59 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:15:59 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:00 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.885s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:16:00 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Deleted volume successfully. Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-23e9b8f2-d539-49b2-b5df-9da1742cdc7b tempest-VolumesExtendTest-1944450026 None] Lock "cinder-c2aecaaf-6f07-455b-94ae-470eb3af3f47-delete_volume" released by "delete_volume" :: held 4.875s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Flow 'volume_create_manager' (7d063fd4-9a90-40a2-a905-f2e19ffcb04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c7d36-d898-4e66-bf39-4387b309d90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c7d36-d898-4e66-bf39-4387b309d90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1320992860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29952960-d7a9-48fa-97cd-eaf6870365f2,host='devstack@QuobyteHD#QuobyteHD',id=1c976b78-2846-4472-bfec-e3fe087502ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a63787e6c247a8ab6fc03dfa1e72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:00Z,use_quota=True,user_id='2c30f411b03f43218ce403b7780a28c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae9b5ca6-10fd-4aad-aef2-8a5977c3a64b),volume_type_id=ae9b5ca6-10fd-4aad-aef2-8a5977c3a64b)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d34dd5-808b-45fd-8367-976005932adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d34dd5-808b-45fd-8367-976005932adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8a6008-fc88-43f3-848c-9bd13c561efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8a6008-fc88-43f3-848c-9bd13c561efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c976b78-2846-4472-bfec-e3fe087502ed', 'volume_name': 'volume-1c976b78-2846-4472-bfec-e3fe087502ed', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2ecf2d-9e2b-4b4e-a749-8220f0de9f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2ecf2d-9e2b-4b4e-a749-8220f0de9f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250b6724-02b6-4590-844f-2e39c2ffe3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:00 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Volume 1c976b78-2846-4472-bfec-e3fe087502ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c976b78-2846-4472-bfec-e3fe087502ed', 'volume_size': 1} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29952960-d7a9-48fa-97cd-eaf6870365f2,created_at=2026-06-23T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1320992860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29952960-d7a9-48fa-97cd-eaf6870365f2,host='devstack@QuobyteHD#QuobyteHD',id=1c976b78-2846-4472-bfec-e3fe087502ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a63787e6c247a8ab6fc03dfa1e72e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:00Z,use_quota=True,user_id='2c30f411b03f43218ce403b7780a28c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae9b5ca6-10fd-4aad-aef2-8a5977c3a64b),volume_type_id=ae9b5ca6-10fd-4aad-aef2-8a5977c3a64b)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Creating volume 1c976b78-2846-4472-bfec-e3fe087502ed {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:16:00 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:16:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:00 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed 1073741824 Jun 23 20:16:00 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Flow 'volume_create_manager' (04e583e9-954b-4473-af66-2e55499354cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8d9422-660f-45fc-af94-929287393ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8d9422-660f-45fc-af94-929287393ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1640736985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e69b9b9-95b5-49b7-9af7-7b055298cf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ea53678e04b4ba144279b521d6e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:01Z,use_quota=True,user_id='b131cb9d0e044dd1abc9b0aa5a5915d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e1783-4aba-49c1-8825-25651247680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e1783-4aba-49c1-8825-25651247680d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6116d6ae-1c78-40ca-9140-390397577741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6116d6ae-1c78-40ca-9140-390397577741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e69b9b9-95b5-49b7-9af7-7b055298cf69', 'volume_name': 'volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0c3c39-0291-47c4-bccf-0d0b07b812ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0c3c39-0291-47c4-bccf-0d0b07b812ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bb36a2-72e1-4093-82e4-318d6538f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:01 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Volume 5e69b9b9-95b5-49b7-9af7-7b055298cf69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69', 'volume_size': 1} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Acquiring lock "cinder-989dead4-89d9-4e31-89aa-7bd507f8c53b-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Lock "cinder-989dead4-89d9-4e31-89aa-7bd507f8c53b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Acquiring lock "cinder-quobyte-989dead4-89d9-4e31-89aa-7bd507f8c53b" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Lock "cinder-quobyte-989dead4-89d9-4e31-89aa-7bd507f8c53b" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5db36d-2e62-4e28-9398-e24f44dc95c7]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:01 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b Jun 23 20:16:01 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:01 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed 1073741824" returned: 0 in 1.193s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:01 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed Jun 23 20:16:01 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:02 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b" returned: 0 in 0.905s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:02 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed" returned: 0 in 0.691s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1640736985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e69b9b9-95b5-49b7-9af7-7b055298cf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ea53678e04b4ba144279b521d6e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:01Z,use_quota=True,user_id='b131cb9d0e044dd1abc9b0aa5a5915d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Creating volume 5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:02 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b Jun 23 20:16:02 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:16:02 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250b6724-02b6-4590-844f-2e39c2ffe3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c976b78-2846-4472-bfec-e3fe087502ed', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aed209-4c2b-4515-a9bc-41dc7950c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:02 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Volume volume-1c976b78-2846-4472-bfec-e3fe087502ed (1c976b78-2846-4472-bfec-e3fe087502ed): created successfully Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aed209-4c2b-4515-a9bc-41dc7950c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:02 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 1073741824 Jun 23 20:16:02 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Flow 'volume_create_manager' (7d063fd4-9a90-40a2-a905-f2e19ffcb04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5aaa8c30-1230-4fec-9ec1-6e5b97c225d8 tempest-GroupSnapshotsTest-1034091370 None] Created volume successfully. Jun 23 20:16:03 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] GroupSnapshot e48e6a6b-ad9c-4d37-b2a3-8e29b15e4f53: creating. Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Group snapshot e48e6a6b-ad9c-4d37-b2a3-8e29b15e4f53: creating. {{(pid=93739) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:03 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-989dead4-89d9-4e31-89aa-7bd507f8c53b" returned: 0 in 0.986s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Lock "cinder-quobyte-989dead4-89d9-4e31-89aa-7bd507f8c53b" released by "delete_volume" :: held 1.940s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Created reservations ['ee31e4fe-65fc-4997-ab98-7c48b2b67ba8', 'af64b5e6-a091-4ea0-854f-45bb193ba1f8', '152375e0-617d-4ad3-9ab0-4e894c4c1a5b', 'eeb836c5-f91a-4709-be88-f5fd2140a648'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:03 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 1073741824" returned: 0 in 1.143s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:03 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:16:03 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:03 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 Jun 23 20:16:03 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:04 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69" returned: 0 in 1.234s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] <== create_volume: return (2464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:16:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.469s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.565s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Creating offline snapshot e9f1d642-dbcf-4546-94a7-cf6583ce1dad of volume 1c976b78-2846-4472-bfec-e3fe087502ed {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bb36a2-72e1-4093-82e4-318d6538f26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdfe72b-5327-4609-8256-50b917b1f3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f55abeb-a76b-4506-a864-82e6bbe9c6d2]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:05 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Volume volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 (5e69b9b9-95b5-49b7-9af7-7b055298cf69): created successfully Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdfe72b-5327-4609-8256-50b917b1f3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Flow 'volume_create_manager' (04e583e9-954b-4473-af66-2e55499354cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:05 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1bc976bc-2b57-4a0e-835e-beebd63164f6 tempest-VolumesExtendTest-1944450026 None] Created volume successfully. Jun 23 20:16:05 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed Jun 23 20:16:05 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:05 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.970s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:16:05 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Deleted volume successfully. Jun 23 20:16:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d628f5f9-872b-4ecf-bf25-a9bf20b2c86a tempest-ServerActionsTestOtherA-1591604329 None] Lock "cinder-989dead4-89d9-4e31-89aa-7bd507f8c53b-delete_volume" released by "delete_volume" :: held 4.299s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed" returned: 0 in 2.066s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:07 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:07 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad 1G Jun 23 20:16:07 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:08 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad 1G" returned: 0 in 1.550s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c976b78-2846-4472-bfec-e3fe087502ed -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:08 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c976b78-2846-4472-bfec-e3fe087502ed -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad Jun 23 20:16:08 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:09 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c976b78-2846-4472-bfec-e3fe087502ed -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad" returned: 0 in 0.656s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:09 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:16:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:09 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad Jun 23 20:16:09 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:10 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad" returned: 0 in 0.731s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:10 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.info Jun 23 20:16:10 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:10 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.info" returned: 0 in 0.606s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:10 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:16:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:10 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.info Jun 23 20:16:10 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:11 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.info" returned: 0 in 0.683s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.467s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.090s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Creating offline snapshot aad2e918-c1a9-4797-8c34-acb956cde711 of volume 5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:16:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[311bb393-1d84-48cc-b9e4-3349ff2c687f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:11 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b7a36400-7fc2-415b-94b4-620101249028 tempest-GroupSnapshotsTest-1034091370 None] group_snapshot e48e6a6b-ad9c-4d37-b2a3-8e29b15e4f53: created successfully Jun 23 20:16:11 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 Jun 23 20:16:11 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:12 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] group_snapshot e48e6a6b-ad9c-4d37-b2a3-8e29b15e4f53: deleting Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] group_snapshot e48e6a6b-ad9c-4d37-b2a3-8e29b15e4f53: deleting {{(pid=93739) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-1c976b78-2846-4472-bfec-e3fe087502ed" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-1c976b78-2846-4472-bfec-e3fe087502ed" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-e9f1d642-dbcf-4546-94a7-cf6583ce1dad" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-e9f1d642-dbcf-4546-94a7-cf6583ce1dad" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Deleting offline snapshot e9f1d642-dbcf-4546-94a7-cf6583ce1dad of volume 1c976b78-2846-4472-bfec-e3fe087502ed {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] snapshot_file for this snap is: volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42bc2b0-7a77-472e-8299-108c450afd6f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:12 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69" returned: 0 in 0.880s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:12 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 1G Jun 23 20:16:12 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:12 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad Jun 23 20:16:12 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:13 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad" returned: 0 in 0.938s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c976b78-2846-4472-bfec-e3fe087502ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:16:13 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 1G" returned: 0 in 0.915s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:13 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2733a2-e214-48e8-bcab-6b98401e57ce]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:13 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 Jun 23 20:16:13 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:13 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed Jun 23 20:16:13 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:14 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed" returned: 0 in 1.287s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:14 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad Jun 23 20:16:14 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:14 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711" returned: 0 in 1.390s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:14 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 is being set with open permissions: ugo+rw Jun 23 20:16:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:14 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 Jun 23 20:16:14 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:15 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711" returned: 0 in 1.302s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:16 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.info Jun 23 20:16:16 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:16 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad" returned: 0 in 1.929s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:16 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad Jun 23 20:16:16 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:17 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.info" returned: 0 in 1.069s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:17 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.info is being set with open permissions: ugo+rw Jun 23 20:16:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:17 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.info Jun 23 20:16:17 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:17 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed.e9f1d642-dbcf-4546-94a7-cf6583ce1dad" returned: 0 in 1.198s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-e9f1d642-dbcf-4546-94a7-cf6583ce1dad" released by "_delete_snapshot" :: held 5.527s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-1c976b78-2846-4472-bfec-e3fe087502ed" released by "delete_snapshot" :: held 5.575s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:17 devstack cinder-volume[93739]: WARNING cinder.quota [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-286724116 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-286724116, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:16:17 devstack cinder-volume[93739]: WARNING cinder.quota [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-286724116 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-286724116, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:16:17 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['a00d592f-be5f-448a-9391-273d26d1d0d3', '4bee2203-e9b7-4958-96cc-e27ff5b70354', '77800522-d6af-4d08-ac54-3eb666d194c8', 'bdee914f-4cb7-43d3-97fd-6d073187d8db'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c4cdcd5a-86e0-432a-947f-d6a5189d3552 tempest-GroupSnapshotsTest-1034091370 None] group_snapshot e48e6a6b-ad9c-4d37-b2a3-8e29b15e4f53: deleted successfully Jun 23 20:16:18 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.info" returned: 0 in 1.133s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.856s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1b6b174e-6799-4dc7-8387-a0e9331ff073 tempest-VolumesExtendTest-1944450026 None] Create snapshot completed successfully Jun 23 20:16:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d2801ec9-3b3a-4206-91ce-e759300786a9 tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d2801ec9-3b3a-4206-91ce-e759300786a9 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:19 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5453e89-e1d0-445e-b647-0dfb6279038e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d2801ec9-3b3a-4206-91ce-e759300786a9 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "cinder-quobyte-1c976b78-2846-4472-bfec-e3fe087502ed" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-1c976b78-2846-4472-bfec-e3fe087502ed" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:19 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b06b4-4eac-43e7-a6a3-eaf9a854e37c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:19 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 Jun 23 20:16:19 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:19 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed Jun 23 20:16:19 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:20 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed" returned: 0 in 1.137s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:20 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed Jun 23 20:16:20 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:20 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d2801ec9-3b3a-4206-91ce-e759300786a9 tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69" returned: 0 in 1.519s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d2801ec9-3b3a-4206-91ce-e759300786a9 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 2G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d2801ec9-3b3a-4206-91ce-e759300786a9 tempest-VolumesExtendTest-1944450026 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 2G" returned: 0 in 0.252s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d2801ec9-3b3a-4206-91ce-e759300786a9 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.876s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d2801ec9-3b3a-4206-91ce-e759300786a9 tempest-VolumesExtendTest-1944450026 None] Extend volume completed successfully. Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Acquiring lock "cinder-aad2e918-c1a9-4797-8c34-acb956cde711-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Lock "cinder-aad2e918-c1a9-4797-8c34-acb956cde711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Acquiring lock "cinder-quobyte-5e69b9b9-95b5-49b7-9af7-7b055298cf69" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Lock "cinder-quobyte-5e69b9b9-95b5-49b7-9af7-7b055298cf69" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Acquiring lock "cinder-quobyte-aad2e918-c1a9-4797-8c34-acb956cde711" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:21 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1c976b78-2846-4472-bfec-e3fe087502ed" returned: 0 in 1.103s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Lock "cinder-quobyte-aad2e918-c1a9-4797-8c34-acb956cde711" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Deleting offline snapshot aad2e918-c1a9-4797-8c34-acb956cde711 of volume 5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] snapshot_file for this snap is: volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Lock "cinder-quobyte-1c976b78-2846-4472-bfec-e3fe087502ed" released by "delete_volume" :: held 2.392s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45e223-8d97-423d-b0ee-113cc96e66c5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:21 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['562e1fff-c9ea-4870-8c3b-772d1ba050ee'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:22 devstack cinder-volume[93739]: WARNING cinder.quota [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-286724116 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-286724116, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Created reservations ['fae4e72d-035c-497d-888f-b44c2191f6a3', 'ea1c746d-5d80-4eb9-baa7-09d568cae2fc', '7d9b9c95-4a3d-4c8c-824e-10369c3a4c46', '6296aee3-15ce-4562-ba84-6901bc8760d0'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:22 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 Jun 23 20:16:22 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:22 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:16:22 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:22 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711" returned: 0 in 1.109s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:16:23 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30080f1-b34b-417d-8b6d-99b700fec22c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:23 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 Jun 23 20:16:23 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:23 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.973s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:23 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:16:23 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d658653b-fe84-4e49-99ee-c14339e65fae tempest-GroupSnapshotsTest-1034091370 None] Delete group completed successfully. Jun 23 20:16:24 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69" returned: 0 in 1.151s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:24 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 Jun 23 20:16:24 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711" returned: 0 in 1.037s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:25 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:25 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711 Jun 23 20:16:25 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:26 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69.aad2e918-c1a9-4797-8c34-acb956cde711" returned: 0 in 0.888s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:26 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=95,cinder:UPDATE=89,cinder:INSERT=32,cinder:DELETE=3 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:16:26 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=113,cinder:SELECT=101,cinder:DELETE=5,cinder:INSERT=27 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:16:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Lock "cinder-quobyte-aad2e918-c1a9-4797-8c34-acb956cde711" released by "_delete_snapshot" :: held 4.401s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Lock "cinder-quobyte-5e69b9b9-95b5-49b7-9af7-7b055298cf69" released by "delete_snapshot" :: held 4.438s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:26 devstack cinder-volume[93739]: WARNING cinder.quota [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:16:26 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Created reservations ['50de7a70-8973-440a-a974-4a1880084efe', 'f3554db6-6739-4c18-917e-422563592fe9', '8722bcce-c6c9-4ed4-88b2-1c407a0b1d6c', '9290f0dc-4d55-4591-aff6-37435ec6f9ea'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:26 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Delete snapshot completed successfully. Jun 23 20:16:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-12088061-c6cc-45af-abfb-e0a2813be30c tempest-VolumesExtendTest-1944450026 None] Lock "cinder-aad2e918-c1a9-4797-8c34-acb956cde711-delete_snapshot" released by "delete_snapshot" :: held 4.688s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Flow 'volume_create_manager' (93c10e1d-7b10-4941-a348-ed5dd872c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fae701e-2aeb-42ad-aa19-58ae80948150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fae701e-2aeb-42ad-aa19-58ae80948150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2138210592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853b3f54-d00f-42b0-873c-a2ce77436498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a47a5a382184fd69a65072bc9fd7e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:27Z,use_quota=True,user_id='34a6608624544e0a9a15582f7907eaa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebd2793-621c-4a9e-8717-a6c8d6fa1b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebd2793-621c-4a9e-8717-a6c8d6fa1b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26e6eea-b6f9-4d95-bdd8-047461c94124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26e6eea-b6f9-4d95-bdd8-047461c94124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853b3f54-d00f-42b0-873c-a2ce77436498', 'volume_name': 'volume-853b3f54-d00f-42b0-873c-a2ce77436498', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4de735-2cba-489d-9658-728172dffb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4de735-2cba-489d-9658-728172dffb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a65c7c-01c2-45da-a4d3-0f98257a51c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:27 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Volume 853b3f54-d00f-42b0-873c-a2ce77436498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853b3f54-d00f-42b0-873c-a2ce77436498', 'volume_size': 1} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2138210592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853b3f54-d00f-42b0-873c-a2ce77436498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a47a5a382184fd69a65072bc9fd7e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:27Z,use_quota=True,user_id='34a6608624544e0a9a15582f7907eaa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Creating volume 853b3f54-d00f-42b0-873c-a2ce77436498 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:16:27 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:27 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 1073741824 Jun 23 20:16:27 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Acquiring lock "cinder-5e69b9b9-95b5-49b7-9af7-7b055298cf69-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Lock "cinder-5e69b9b9-95b5-49b7-9af7-7b055298cf69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Acquiring lock "cinder-quobyte-5e69b9b9-95b5-49b7-9af7-7b055298cf69" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Lock "cinder-quobyte-5e69b9b9-95b5-49b7-9af7-7b055298cf69" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8771aa89-4b41-49f4-8f45-975de2246cf8]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:27 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 Jun 23 20:16:27 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:28 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 1073741824" returned: 0 in 1.044s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:28 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 Jun 23 20:16:28 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:28 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69" returned: 0 in 0.971s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:28 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69 Jun 23 20:16:28 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:29 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498" returned: 0 in 0.853s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a65c7c-01c2-45da-a4d3-0f98257a51c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853b3f54-d00f-42b0-873c-a2ce77436498', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3db3d57-3dd9-470a-b419-685548dd0909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:29 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Volume volume-853b3f54-d00f-42b0-873c-a2ce77436498 (853b3f54-d00f-42b0-873c-a2ce77436498): created successfully Jun 23 20:16:29 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3db3d57-3dd9-470a-b419-685548dd0909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Flow 'volume_create_manager' (93c10e1d-7b10-4941-a348-ed5dd872c647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5e69b9b9-95b5-49b7-9af7-7b055298cf69" returned: 0 in 0.803s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Lock "cinder-quobyte-5e69b9b9-95b5-49b7-9af7-7b055298cf69" released by "delete_volume" :: held 1.869s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b281ef07-aacf-4b74-aab3-1746afa82367 tempest-ServersNegativeTestJSON-1812520871 None] Created volume successfully. Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Created reservations ['28f9900d-822a-422d-a3a0-40f7d446702d', '701c68eb-34cd-4533-a012-ed9c966b864f', '18344b40-830d-4c6e-9b5e-a936b9f48f59', 'f8a2cb08-27fb-4496-8359-06a67f0a5c05'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3249cb40-b4d2-460a-88df-1b0664493fd9 tempest-GroupSnapshotsV319Test-1771956330 None] Group tempest-GroupSnapshotsV319Test-Group-1258306989: creating Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:29 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:16:29 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3249cb40-b4d2-460a-88df-1b0664493fd9 tempest-GroupSnapshotsV319Test-1771956330 None] Group tempest-GroupSnapshotsV319Test-Group-1258306989: created successfully Jun 23 20:16:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3249cb40-b4d2-460a-88df-1b0664493fd9 tempest-GroupSnapshotsV319Test-1771956330 None] Create group completed successfully. Jun 23 20:16:30 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.715s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:30 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:16:30 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Deleted volume successfully. Jun 23 20:16:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-99dbc4b5-cef3-42c6-9c63-41273aa48a58 tempest-VolumesExtendTest-1944450026 None] Lock "cinder-5e69b9b9-95b5-49b7-9af7-7b055298cf69-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Flow 'volume_create_manager' (693714d0-3e4a-484c-9187-7d3f1785625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb196d7f-f484-4b02-a22b-d15c1cceb8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb196d7f-f484-4b02-a22b-d15c1cceb8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-429241726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=713a2037-8b60-43cc-b36c-4309f387beaa,host='devstack@QuobyteHD#QuobyteHD',id=95b198ed-5a90-4fc2-8182-90162fc4a5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4a14f738e4b08af49737c0f0e1fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:31Z,use_quota=True,user_id='aefd566be2cc456b84a83653eb86bdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(761ae14b-e1f9-4e4b-8164-2bec0eef7d8b),volume_type_id=761ae14b-e1f9-4e4b-8164-2bec0eef7d8b)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b6e3e8-1b74-4fa8-b86e-e90f570b7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b6e3e8-1b74-4fa8-b86e-e90f570b7919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b16e69f-0edf-4c1e-b756-a7ba979d5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b16e69f-0edf-4c1e-b756-a7ba979d5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b198ed-5a90-4fc2-8182-90162fc4a5bb', 'volume_name': 'volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449760b6-ff30-43d7-8c0f-3276ace93569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449760b6-ff30-43d7-8c0f-3276ace93569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cadc165-e67d-46ea-a1d9-b14441299038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:31 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Volume 95b198ed-5a90-4fc2-8182-90162fc4a5bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb', 'volume_size': 1} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=713a2037-8b60-43cc-b36c-4309f387beaa,created_at=2026-06-23T18:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-429241726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=713a2037-8b60-43cc-b36c-4309f387beaa,host='devstack@QuobyteHD#QuobyteHD',id=95b198ed-5a90-4fc2-8182-90162fc4a5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4a14f738e4b08af49737c0f0e1fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:31Z,use_quota=True,user_id='aefd566be2cc456b84a83653eb86bdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(761ae14b-e1f9-4e4b-8164-2bec0eef7d8b),volume_type_id=761ae14b-e1f9-4e4b-8164-2bec0eef7d8b)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Creating volume 95b198ed-5a90-4fc2-8182-90162fc4a5bb {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:16:31 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:16:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:31 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb 1073741824 Jun 23 20:16:31 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:32 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb 1073741824" returned: 0 in 1.322s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:33 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb Jun 23 20:16:33 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Flow 'volume_create_manager' (171e13f5-c8c9-4757-946f-04e9e528ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afeb0ad3-75fd-428e-abf8-a7b6e1f2080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afeb0ad3-75fd-428e-abf8-a7b6e1f2080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-458661156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e487375-62a7-41f8-98a6-b93a5019a4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a47a5a382184fd69a65072bc9fd7e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:33Z,use_quota=True,user_id='34a6608624544e0a9a15582f7907eaa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417105c2-949a-4bcd-bcc4-1d7f98793449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417105c2-949a-4bcd-bcc4-1d7f98793449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8858662-24fc-4589-abcd-c9d18543dd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8858662-24fc-4589-abcd-c9d18543dd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e487375-62a7-41f8-98a6-b93a5019a4d2', 'volume_name': 'volume-4e487375-62a7-41f8-98a6-b93a5019a4d2', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2b5d02-0c6e-4bfc-9aa9-b7e5b682658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2b5d02-0c6e-4bfc-9aa9-b7e5b682658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2121fff0-d049-4884-b78b-bf8686b5e8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:33 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Volume 4e487375-62a7-41f8-98a6-b93a5019a4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e487375-62a7-41f8-98a6-b93a5019a4d2', 'volume_size': 1} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:33 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb" returned: 0 in 1.038s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:16:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.432s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-458661156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e487375-62a7-41f8-98a6-b93a5019a4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a47a5a382184fd69a65072bc9fd7e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:33Z,use_quota=True,user_id='34a6608624544e0a9a15582f7907eaa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Creating volume 4e487375-62a7-41f8-98a6-b93a5019a4d2 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:16:34 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cadc165-e67d-46ea-a1d9-b14441299038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d8b512-e69b-42c1-be7e-93a48fd98a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:34 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 1073741824 Jun 23 20:16:34 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Volume volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb (95b198ed-5a90-4fc2-8182-90162fc4a5bb): created successfully Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d8b512-e69b-42c1-be7e-93a48fd98a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Flow 'volume_create_manager' (693714d0-3e4a-484c-9187-7d3f1785625f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a997538d-c922-48e0-9433-c691e7714f1c tempest-GroupSnapshotsV319Test-1771956330 None] Created volume successfully. Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Flow 'volume_create_manager' (fb96461b-a019-4a7f-a2e5-dce736ccdf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f90fbe-1bdb-4f7d-84a7-893758d554df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f90fbe-1bdb-4f7d-84a7-893758d554df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1532403224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34c922023cc4b8b9e3eadf0bf5000ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:34Z,use_quota=True,user_id='77c0ebcee7ba4ae1a38c8cc6ee6c32fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d4db80-f380-4c3c-86f6-23817dd24573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d4db80-f380-4c3c-86f6-23817dd24573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ce76f9-6c70-46ec-b54d-c3d0726463f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ce76f9-6c70-46ec-b54d-c3d0726463f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4', 'volume_name': 'volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c014151-77bb-4634-9d95-9daf5a95d72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c014151-77bb-4634-9d95-9daf5a95d72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2cdab5-52de-4dbd-9b0b-9e2563cfa4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Volume 8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4', 'volume_size': 1} Jun 23 20:16:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:35 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 1073741824" returned: 0 in 1.205s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:35 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 Jun 23 20:16:35 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:35 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] GroupSnapshot 6be9b8cd-ae32-4be2-8d86-022d23a27b19: creating. Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Group snapshot 6be9b8cd-ae32-4be2-8d86-022d23a27b19: creating. {{(pid=93739) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:35 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2" returned: 0 in 0.686s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1532403224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34c922023cc4b8b9e3eadf0bf5000ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:16:34Z,use_quota=True,user_id='77c0ebcee7ba4ae1a38c8cc6ee6c32fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Creating volume 8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:16:35 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:16:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:36 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 1073741824 Jun 23 20:16:36 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2121fff0-d049-4884-b78b-bf8686b5e8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e487375-62a7-41f8-98a6-b93a5019a4d2', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaf5aad-b4b5-48ad-bb22-4b40e2048e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Volume volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 (4e487375-62a7-41f8-98a6-b93a5019a4d2): created successfully Jun 23 20:16:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaf5aad-b4b5-48ad-bb22-4b40e2048e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Flow 'volume_create_manager' (171e13f5-c8c9-4757-946f-04e9e528ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ef05cb95-6ca0-4a53-875b-f08bf49ce7eb tempest-ServersNegativeTestJSON-1812520871 None] Created volume successfully. Jun 23 20:16:36 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 1073741824" returned: 0 in 0.926s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:36 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 Jun 23 20:16:36 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "cinder-4e487375-62a7-41f8-98a6-b93a5019a4d2-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Lock "cinder-4e487375-62a7-41f8-98a6-b93a5019a4d2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "cinder-quobyte-4e487375-62a7-41f8-98a6-b93a5019a4d2" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Lock "cinder-quobyte-4e487375-62a7-41f8-98a6-b93a5019a4d2" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aab3669-9ed9-4a4b-8b88-e72846a0c90f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:37 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 Jun 23 20:16:37 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:37 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4" returned: 0 in 0.823s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.372s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2cdab5-52de-4dbd-9b0b-9e2563cfa4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80b1beb-f10e-48be-b4a5-31cd4b15a46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Creating offline snapshot fa6abec2-b190-4ebe-be49-cbc02dc47533 of volume 95b198ed-5a90-4fc2-8182-90162fc4a5bb {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:16:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Volume volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 (8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4): created successfully Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80b1beb-f10e-48be-b4a5-31cd4b15a46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Flow 'volume_create_manager' (fb96461b-a019-4a7f-a2e5-dce736ccdf95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac37426-bc46-4838-96e7-fb0f5680b6a3]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-719bdf6b-8243-4ae8-8d47-dd5c67d4b20f tempest-VolumesNegativeTest-582809601 None] Created volume successfully. Jun 23 20:16:37 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb Jun 23 20:16:37 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:38 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2" returned: 0 in 0.820s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:38 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2 Jun 23 20:16:38 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:39 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb" returned: 0 in 1.224s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:39 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 1G Jun 23 20:16:39 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:39 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4e487375-62a7-41f8-98a6-b93a5019a4d2" returned: 0 in 0.948s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Lock "cinder-quobyte-4e487375-62a7-41f8-98a6-b93a5019a4d2" released by "delete_volume" :: held 1.829s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Created reservations ['b665818e-165d-4753-8aa9-eb664eb5b5c2', '7c707c0b-a944-4280-a959-8e46a6ed91f5', '0a4346e6-4801-476d-9278-623e4911eba5', '401d6fc3-ae15-4a22-bccd-62be1a0afe7a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:39 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:16:39 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "cinder-853b3f54-d00f-42b0-873c-a2ce77436498-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Lock "cinder-853b3f54-d00f-42b0-873c-a2ce77436498-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "cinder-quobyte-853b3f54-d00f-42b0-873c-a2ce77436498" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Lock "cinder-quobyte-853b3f54-d00f-42b0-873c-a2ce77436498" acquired by "delete_volume" :: waited 0.036s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2022b18-2fa7-49c7-9dbb-4c9ac16910eb]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:40 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 Jun 23 20:16:40 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:40 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 1G" returned: 0 in 1.333s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:40 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 Jun 23 20:16:40 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:40 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.039s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:16:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Deleted volume successfully. Jun 23 20:16:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a24449e9-5c92-4987-aa0a-bf189c2b09a9 tempest-ServersNegativeTestJSON-1812520871 None] Lock "cinder-4e487375-62a7-41f8-98a6-b93a5019a4d2-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:41 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498" returned: 0 in 1.125s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:41 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533" returned: 0 in 0.889s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:41 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:16:41 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498 Jun 23 20:16:41 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:41 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 Jun 23 20:16:41 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:42 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-853b3f54-d00f-42b0-873c-a2ce77436498" returned: 0 in 0.775s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Lock "cinder-quobyte-853b3f54-d00f-42b0-873c-a2ce77436498" released by "delete_volume" :: held 1.958s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:42 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533" returned: 0 in 0.807s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Created reservations ['38cba155-08eb-482f-b178-28a1dcfebb0c', 'cfc4f807-7b97-40dd-bc23-97cf0a7b39c9', '17273597-3ca8-43b3-bf3b-fceab55a9474', '4c7cc4fd-fde3-421d-a4e7-5f921ba0f19a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:42 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.info Jun 23 20:16:42 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:42 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:16:42 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:42 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.info" returned: 0 in 0.713s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:42 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:16:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:42 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.info Jun 23 20:16:42 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:43 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.896s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:43 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:16:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Deleted volume successfully. Jun 23 20:16:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d15a0a89-f324-48a8-be9a-b882864f8dfc tempest-ServersNegativeTestJSON-1812520871 None] Lock "cinder-853b3f54-d00f-42b0-873c-a2ce77436498-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:43 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.info" returned: 0 in 0.967s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.073s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-93119f25-1e96-4349-874c-006606b2c392 tempest-GroupSnapshotsV319Test-1771956330 None] group_snapshot 6be9b8cd-ae32-4be2-8d86-022d23a27b19: created successfully Jun 23 20:16:45 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] group_snapshot 6be9b8cd-ae32-4be2-8d86-022d23a27b19: deleting Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] group_snapshot 6be9b8cd-ae32-4be2-8d86-022d23a27b19: deleting {{(pid=93739) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Acquiring lock "cinder-quobyte-95b198ed-5a90-4fc2-8182-90162fc4a5bb" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Lock "cinder-quobyte-95b198ed-5a90-4fc2-8182-90162fc4a5bb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Acquiring lock "cinder-quobyte-fa6abec2-b190-4ebe-be49-cbc02dc47533" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Lock "cinder-quobyte-fa6abec2-b190-4ebe-be49-cbc02dc47533" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Deleting offline snapshot fa6abec2-b190-4ebe-be49-cbc02dc47533 of volume 95b198ed-5a90-4fc2-8182-90162fc4a5bb {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] snapshot_file for this snap is: volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a287e1c0-cb6d-4629-8a86-83761e8693f9]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:46 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 Jun 23 20:16:46 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:16:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:46 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:16:46 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:47 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533" returned: 0 in 1.131s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:16:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab07b07-4bc2-4d7f-b28a-2f40a67e56f8]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:47 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb Jun 23 20:16:47 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:47 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.124s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:16:48 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb" returned: 0 in 1.419s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:48 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 Jun 23 20:16:48 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:49 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533" returned: 0 in 1.065s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:49 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533 Jun 23 20:16:49 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:50 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb.fa6abec2-b190-4ebe-be49-cbc02dc47533" returned: 0 in 0.742s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Lock "cinder-quobyte-fa6abec2-b190-4ebe-be49-cbc02dc47533" released by "_delete_snapshot" :: held 4.512s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Lock "cinder-quobyte-95b198ed-5a90-4fc2-8182-90162fc4a5bb" released by "delete_snapshot" :: held 4.562s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:50 devstack cinder-volume[93739]: WARNING cinder.quota [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-362473138 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-362473138, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:16:50 devstack cinder-volume[93739]: WARNING cinder.quota [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-362473138 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-362473138, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:16:50 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] Created reservations ['6757c226-f703-4439-adc8-2cf00fa79f40', '011417f3-f438-4901-a4bc-87dc2e2b387d', 'a928dcd0-08c1-4f33-9816-3019845bac4d', '339e3bdb-d1eb-4565-b7fa-4883f6c7bd02'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1a024a96-fef3-4f02-b643-8b1893d9478e tempest-GroupSnapshotsV319Test-1771956330 None] group_snapshot 6be9b8cd-ae32-4be2-8d86-022d23a27b19: deleted successfully Jun 23 20:16:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Acquiring lock "cinder-quobyte-95b198ed-5a90-4fc2-8182-90162fc4a5bb" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:16:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Lock "cinder-quobyte-95b198ed-5a90-4fc2-8182-90162fc4a5bb" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:16:51 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1affd126-026f-4fc9-ad29-549192523400]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:16:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:51 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb Jun 23 20:16:51 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:52 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb" returned: 0 in 0.854s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:52 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb Jun 23 20:16:52 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:53 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-95b198ed-5a90-4fc2-8182-90162fc4a5bb" returned: 0 in 0.782s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Lock "cinder-quobyte-95b198ed-5a90-4fc2-8182-90162fc4a5bb" released by "delete_volume" :: held 1.712s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Created reservations ['9ecaacd8-b7bb-4d54-b29e-71c03abdab21'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:53 devstack cinder-volume[93739]: WARNING cinder.quota [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-362473138 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-362473138, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Created reservations ['8a3e710e-3f9b-4840-8ce9-99b1e60546af', '1a5bc8a1-3017-4d61-a0c2-2917e7fff0cb', '0958e827-0fd4-4e37-9d22-83909721ec36', 'c8a43f4a-e1c3-44a3-884c-c173f070a63b'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:16:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:16:53 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:16:53 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:16:54 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jun 23 20:16:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.723s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:16:54 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:16:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-759246c8-8a3c-42eb-995d-1318e8137352 tempest-GroupSnapshotsV319Test-1771956330 None] Delete group completed successfully. Jun 23 20:17:03 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=57,cinder:INSERT=15,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:17:03 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=43,cinder:INSERT=15,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:17:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-819aa9ee-22fd-4715-a5be-018f5f6e8a22 tempest-GroupsV314Test-880468676 None] Group tempest-GroupsV314Test-Group-1948541882: creating Jun 23 20:17:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-819aa9ee-22fd-4715-a5be-018f5f6e8a22 tempest-GroupsV314Test-880468676 None] Group tempest-GroupsV314Test-Group-1948541882: created successfully Jun 23 20:17:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-819aa9ee-22fd-4715-a5be-018f5f6e8a22 tempest-GroupsV314Test-880468676 None] Create group completed successfully. Jun 23 20:17:15 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:17:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Flow 'volume_create_manager' (82e2681e-74b3-4a0d-a5ca-20973aa1d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:17:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72f0deb-b948-4280-a0eb-d39b464dfd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72f0deb-b948-4280-a0eb-d39b464dfd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-623446084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=427a2fbf-9b7d-4553-9dbc-79ff49baa71f,host='devstack@QuobyteHD#QuobyteHD',id=2832a2f6-ffab-40a4-89b1-45e28473a62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fcaaf559b04859b32d1e3012bd117b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:17:16Z,use_quota=True,user_id='218abfca6e164d739558c3057eb5c262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(495dc455-7e1e-46a5-8fb9-d06e39c3a927),volume_type_id=495dc455-7e1e-46a5-8fb9-d06e39c3a927)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fcaabb-41f0-46b4-8678-40022ba1e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fcaabb-41f0-46b4-8678-40022ba1e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3196ba1f-43db-4e42-a6de-aabb217b4121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3196ba1f-43db-4e42-a6de-aabb217b4121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2832a2f6-ffab-40a4-89b1-45e28473a62b', 'volume_name': 'volume-2832a2f6-ffab-40a4-89b1-45e28473a62b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc4c030-fc7b-4c58-980a-dc062e4d9114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc4c030-fc7b-4c58-980a-dc062e4d9114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343b96e5-9b85-4ba9-bd9c-4a52a5bd6283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:16 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Volume 2832a2f6-ffab-40a4-89b1-45e28473a62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2832a2f6-ffab-40a4-89b1-45e28473a62b', 'volume_size': 1} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=427a2fbf-9b7d-4553-9dbc-79ff49baa71f,created_at=2026-06-23T18:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-623446084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=427a2fbf-9b7d-4553-9dbc-79ff49baa71f,host='devstack@QuobyteHD#QuobyteHD',id=2832a2f6-ffab-40a4-89b1-45e28473a62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fcaaf559b04859b32d1e3012bd117b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:17:16Z,use_quota=True,user_id='218abfca6e164d739558c3057eb5c262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(495dc455-7e1e-46a5-8fb9-d06e39c3a927),volume_type_id=495dc455-7e1e-46a5-8fb9-d06e39c3a927)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Creating volume 2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:17:16 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:17:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:16 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b 1073741824 Jun 23 20:17:16 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:17 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b 1073741824" returned: 0 in 1.337s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:17 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b Jun 23 20:17:17 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:18 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b" returned: 0 in 0.706s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:17:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343b96e5-9b85-4ba9-bd9c-4a52a5bd6283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2832a2f6-ffab-40a4-89b1-45e28473a62b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a75e4dc-c839-4b3f-add2-a7d143237a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:18 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Volume volume-2832a2f6-ffab-40a4-89b1-45e28473a62b (2832a2f6-ffab-40a4-89b1-45e28473a62b): created successfully Jun 23 20:17:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a75e4dc-c839-4b3f-add2-a7d143237a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Flow 'volume_create_manager' (82e2681e-74b3-4a0d-a5ca-20973aa1d598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:17:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3b842b45-067c-4820-baa4-249b16b7756e tempest-GroupsV314Test-880468676 None] Created volume successfully. Jun 23 20:17:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:19 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Cloning volume 2832a2f6-ffab-40a4-89b1-45e28473a62b to volume d4f33acc-e5a3-453d-8b05-11586f9df936 Jun 23 20:17:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Creating offline snapshot 97b688eb-6cd5-4ab2-9904-18fe80361abd of volume 2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:17:19 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b6f59-75b0-4073-a172-fe7947ee1f70]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:19 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b Jun 23 20:17:19 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:20 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b" returned: 0 in 1.227s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:20 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd 1G Jun 23 20:17:20 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Acquiring lock "cinder-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Lock "cinder-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Acquiring lock "cinder-quobyte-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Lock "cinder-quobyte-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:21 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd70c5bc-ca23-451c-95eb-b427d57f7cbb]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:21 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 Jun 23 20:17:21 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:22 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd 1G" returned: 0 in 1.248s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2832a2f6-ffab-40a4-89b1-45e28473a62b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:22 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2832a2f6-ffab-40a4-89b1-45e28473a62b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd Jun 23 20:17:22 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:22 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4" returned: 0 in 1.072s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:22 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4 Jun 23 20:17:22 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:23 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2832a2f6-ffab-40a4-89b1-45e28473a62b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd" returned: 0 in 0.830s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:23 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:23 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:23 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd Jun 23 20:17:23 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4" returned: 0 in 0.734s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Lock "cinder-quobyte-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4" released by "delete_volume" :: held 1.890s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Created reservations ['3e1a4a75-a0ac-49dc-bf6c-f3e68818927e', 'f57819c4-9fd4-4da0-bd4f-e05d098eb2d9', 'cadf1d0a-75da-4d96-8311-6fbf5db85fbc', '629f4925-f9ee-4962-9056-6ac6161bb15a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:23 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:17:23 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:23 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd" returned: 0 in 0.693s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:23 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.info Jun 23 20:17:23 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:23 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.729s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:17:23 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Deleted volume successfully. Jun 23 20:17:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b1ddc71f-59f2-4bc3-98eb-70ca0d429af2 tempest-VolumesNegativeTest-582809601 None] Lock "cinder-8ccd0386-4b6c-4cc0-879c-bbc9ac82e4f4-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:24 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.info" returned: 0 in 0.726s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:24 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:17:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:24 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.info Jun 23 20:17:24 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:25 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.info" returned: 0 in 0.711s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Acquiring lock "cinder-quobyte-d4f33acc-e5a3-453d-8b05-11586f9df936" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Lock "cinder-quobyte-d4f33acc-e5a3-453d-8b05-11586f9df936" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] snapshot: 97b688eb-6cd5-4ab2-9904-18fe80361abd, volume: d4f33acc-e5a3-453d-8b05-11586f9df936, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e4ce10-3bbd-46ec-a747-952e81c11075]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:25 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd Jun 23 20:17:25 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Flow 'volume_create_manager' (c77866f3-faf8-4314-8075-a83eb100331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f19018e-c337-4b26-aa68-b31fbc84ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f19018e-c337-4b26-aa68-b31fbc84ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-44878978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee392c81-2240-42bb-8ed5-46ba55d871ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c812e38640ce4b2da521ee0a679e1405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:17:26Z,use_quota=True,user_id='0861987b7efd4b2393a747f8248c3eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f23f585-45ea-4deb-96a7-1a2b89d01463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f23f585-45ea-4deb-96a7-1a2b89d01463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cd8b39-0a57-42dc-855e-a53b4b2724dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cd8b39-0a57-42dc-855e-a53b4b2724dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee392c81-2240-42bb-8ed5-46ba55d871ed', 'volume_name': 'volume-ee392c81-2240-42bb-8ed5-46ba55d871ed', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d0f68a-7554-4c27-a440-6557da7e0873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d0f68a-7554-4c27-a440-6557da7e0873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d7961c-318a-4815-845c-72e703389dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:26 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Volume ee392c81-2240-42bb-8ed5-46ba55d871ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee392c81-2240-42bb-8ed5-46ba55d871ed', 'volume_size': 1} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd" returned: 0 in 1.002s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2832a2f6-ffab-40a4-89b1-45e28473a62b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:17:26 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b91ad3-0b7a-40d9-b53b-6034fb270bce]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:26 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b Jun 23 20:17:26 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:27 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b" returned: 0 in 1.012s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:27 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:17:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:27 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 Jun 23 20:17:27 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:33 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936" returned: 0 in 6.259s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:33 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f228fa3-db0b-44e8-b089-ed57b709b780]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:33 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b Jun 23 20:17:33 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:34 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b" returned: 0 in 1.108s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:34 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:17:34 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Converted 1024.00 MB image at 163.54 MB/s Jun 23 20:17:34 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 20:17:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:34 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 Jun 23 20:17:34 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:35 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936" returned: 0 in 0.674s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Lock "cinder-quobyte-d4f33acc-e5a3-453d-8b05-11586f9df936" released by "_copy_volume_from_snapshot" :: held 10.170s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Acquiring lock "cinder-quobyte-97b688eb-6cd5-4ab2-9904-18fe80361abd" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Lock "cinder-quobyte-97b688eb-6cd5-4ab2-9904-18fe80361abd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Deleting offline snapshot 97b688eb-6cd5-4ab2-9904-18fe80361abd of volume 2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:17:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] snapshot_file for this snap is: volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:17:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3a67d-7d30-4ab5-b75d-6a98e87fa0f0]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:35 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd Jun 23 20:17:35 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:36 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=5 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:17:36 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd" returned: 0 in 0.889s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2832a2f6-ffab-40a4-89b1-45e28473a62b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:17:36 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aa948f-291e-4d80-bff2-cf59cdde5082]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:36 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b Jun 23 20:17:36 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:37 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b" returned: 0 in 1.583s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:38 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd Jun 23 20:17:38 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:39 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd" returned: 0 in 1.087s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:39 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd Jun 23 20:17:39 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:40 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b.97b688eb-6cd5-4ab2-9904-18fe80361abd" returned: 0 in 1.217s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Lock "cinder-quobyte-97b688eb-6cd5-4ab2-9904-18fe80361abd" released by "_delete_snapshot" :: held 4.896s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.760s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.208s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-44878978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee392c81-2240-42bb-8ed5-46ba55d871ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c812e38640ce4b2da521ee0a679e1405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:17:26Z,use_quota=True,user_id='0861987b7efd4b2393a747f8248c3eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Creating volume ee392c81-2240-42bb-8ed5-46ba55d871ed {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:17:40 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:17:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:40 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed 1073741824 Jun 23 20:17:40 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d1ff228d-6a6a-4b62-8849-24598db04390 tempest-GroupsV314Test-880468676 None] Create group from source-group-427a2fbf-9b7d-4553-9dbc-79ff49baa71f completed successfully. Jun 23 20:17:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Acquiring lock "cinder-quobyte-d4f33acc-e5a3-453d-8b05-11586f9df936" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Lock "cinder-quobyte-d4f33acc-e5a3-453d-8b05-11586f9df936" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:41 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cc3971-6e8f-43a7-8b2f-aba689a885d7]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:42 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 Jun 23 20:17:42 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:42 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed 1073741824" returned: 0 in 1.850s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:42 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed Jun 23 20:17:42 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:43 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed" returned: 0 in 1.069s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] <== create_volume: return (3006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d7961c-318a-4815-845c-72e703389dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee392c81-2240-42bb-8ed5-46ba55d871ed', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69faba9-5b82-4b72-8560-fe23adf4c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:43 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Volume volume-ee392c81-2240-42bb-8ed5-46ba55d871ed (ee392c81-2240-42bb-8ed5-46ba55d871ed): created successfully Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69faba9-5b82-4b72-8560-fe23adf4c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Flow 'volume_create_manager' (c77866f3-faf8-4314-8075-a83eb100331e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:17:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-227c2c87-7ac5-4708-b347-6f8c122d4f70 tempest-AttachVolumeTestJSON-462274605 None] Created volume successfully. Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (c55aa6c2-27b6-4c70-8339-7d74194da8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958f9003-1f54-4571-bebb-40b698a1f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958f9003-1f54-4571-bebb-40b698a1f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-269130767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecca801a-194e-45ee-8cca-bd84dc5ccd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39427117a6c445391715694114417be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:17:44Z,use_quota=True,user_id='b0a9646b11274cc4b2025ac02512421f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4a7862-6d99-4ea9-8de1-b57bcbba1c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4a7862-6d99-4ea9-8de1-b57bcbba1c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c061bdc-af9e-4d01-bd8d-a44f072fee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c061bdc-af9e-4d01-bd8d-a44f072fee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecca801a-194e-45ee-8cca-bd84dc5ccd4a', 'volume_name': 'volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26ecbac-8136-4521-ab67-d19fe5caf64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26ecbac-8136-4521-ab67-d19fe5caf64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429882e0-778e-4627-8ffb-2851fe331da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:43 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Volume ecca801a-194e-45ee-8cca-bd84dc5ccd4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a', 'volume_size': 1} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-269130767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecca801a-194e-45ee-8cca-bd84dc5ccd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39427117a6c445391715694114417be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:17:44Z,use_quota=True,user_id='b0a9646b11274cc4b2025ac02512421f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Creating volume ecca801a-194e-45ee-8cca-bd84dc5ccd4a {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:43 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:17:43 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936" returned: 0 in 1.854s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:43 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a 1073741824 Jun 23 20:17:43 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:43 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936 Jun 23 20:17:43 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:44 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f33acc-e5a3-453d-8b05-11586f9df936" returned: 0 in 0.802s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:44 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Lock "cinder-quobyte-d4f33acc-e5a3-453d-8b05-11586f9df936" released by "delete_volume" :: held 2.719s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:44 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Created reservations ['0b6fbef1-aced-4b67-acd6-22dc460b34d2'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:17:44 devstack cinder-volume[93739]: WARNING cinder.quota [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2027445713 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2027445713, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:17:44 devstack cinder-volume[93739]: WARNING cinder.quota [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2027445713 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2027445713, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:17:44 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Created reservations ['2369fd24-d090-447f-b7bd-7877f1e73cc2', '05194196-fc8f-4fb8-89dd-213073162d1b', 'e137af3a-ef39-447d-8081-6ca6cf275652', '34ba51b6-bdf6-487d-8b94-672d32709a46'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:45 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:17:45 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:45 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a 1073741824" returned: 0 in 1.283s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:45 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a Jun 23 20:17:45 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:45 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.767s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:45 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:17:45 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3887ce4d-6b47-4558-b534-26d5c5a7adf0 tempest-GroupsV314Test-880468676 None] Delete group completed successfully. Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" returned: 0 in 0.710s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429882e0-778e-4627-8ffb-2851fe331da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c283ec-b69a-432d-aa69-43664b0596f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:45 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Volume volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a (ecca801a-194e-45ee-8cca-bd84dc5ccd4a): created successfully Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c283ec-b69a-432d-aa69-43664b0596f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (c55aa6c2-27b6-4c70-8339-7d74194da8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:17:45 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-6b0cdddd-0036-4f2f-a002-50623cc9587a tempest-VolumesSnapshotTestJSON-1664657091 None] Created volume successfully. Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Acquiring lock "cinder-quobyte-2832a2f6-ffab-40a4-89b1-45e28473a62b" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Lock "cinder-quobyte-2832a2f6-ffab-40a4-89b1-45e28473a62b" acquired by "delete_volume" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ea76af-08b2-4535-b0af-e7a04457573d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:46 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b Jun 23 20:17:46 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:46 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:17:46 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Creating offline snapshot 2758eea6-8d67-4464-9db8-6ec445ac27ca of volume ecca801a-194e-45ee-8cca-bd84dc5ccd4a {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[37731927-58ff-40de-8877-2ef954f8accd]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:47 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b" returned: 0 in 1.113s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:47 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b Jun 23 20:17:47 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:47 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a Jun 23 20:17:47 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:47 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.164s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:17:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-ee87ab96-6a9f-4ea5-8146-c9c6cf6f93f0 req-96fe52c9-f86b-4533-b1d5-a457dc5a0225 tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:48 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2832a2f6-ffab-40a4-89b1-45e28473a62b" returned: 0 in 0.810s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Lock "cinder-quobyte-2832a2f6-ffab-40a4-89b1-45e28473a62b" released by "delete_volume" :: held 1.992s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Created reservations ['c96ef518-2c6e-41ee-b785-5cb4c2def9e3'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:17:48 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Created reservations ['0d4ae053-fbd3-48dd-8db1-0cf49651f686', 'aef498fa-5e1a-4c89-877b-5bb0666d6778', '71c0da24-e1a2-4f56-bc44-165350abe973', 'b691b985-a80c-40f7-8e41-28e657f0f5b4'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" returned: 0 in 1.109s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:48 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca 1G Jun 23 20:17:48 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:48 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:17:48 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:49 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.758s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:49 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:17:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0ae2d921-b4cf-477e-b120-d5541e1c88b6 tempest-GroupsV314Test-880468676 None] Delete group completed successfully. Jun 23 20:17:49 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca 1G" returned: 0 in 1.019s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:49 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca Jun 23 20:17:49 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:50 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca" returned: 0 in 0.760s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:50 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca is being set with open permissions: ugo+rw Jun 23 20:17:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:50 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca Jun 23 20:17:50 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:50 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca" returned: 0 in 0.738s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:50 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.info Jun 23 20:17:50 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:51 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.info" returned: 0 in 0.872s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:51 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.info is being set with open permissions: ugo+rw Jun 23 20:17:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:51 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.info Jun 23 20:17:51 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:52 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.info" returned: 0 in 0.745s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.356s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-ee87ab96-6a9f-4ea5-8146-c9c6cf6f93f0 req-96fe52c9-f86b-4533-b1d5-a457dc5a0225 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.552s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:52 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b178c9a-d25f-49ee-ab5e-b2b215f9a33d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-ee87ab96-6a9f-4ea5-8146-c9c6cf6f93f0 req-96fe52c9-f86b-4533-b1d5-a457dc5a0225 tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:52 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4c77758f-2634-46e0-b808-261a9b8c4cea tempest-VolumesSnapshotTestJSON-1664657091 None] Create snapshot completed successfully Jun 23 20:17:52 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed Jun 23 20:17:52 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:53 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-ee87ab96-6a9f-4ea5-8146-c9c6cf6f93f0 req-96fe52c9-f86b-4533-b1d5-a457dc5a0225 tempest-AttachVolumeTestJSON-462274605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed" returned: 0 in 0.825s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-ee87ab96-6a9f-4ea5-8146-c9c6cf6f93f0 req-96fe52c9-f86b-4533-b1d5-a457dc5a0225 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-ee87ab96-6a9f-4ea5-8146-c9c6cf6f93f0 req-96fe52c9-f86b-4533-b1d5-a457dc5a0225 tempest-AttachVolumeTestJSON-462274605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-ee392c81-2240-42bb-8ed5-46ba55d871ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7b677b7-573e-4f19-ac51-6be7bf5bdd91', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:17:53 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-ee87ab96-6a9f-4ea5-8146-c9c6cf6f93f0 req-96fe52c9-f86b-4533-b1d5-a457dc5a0225 tempest-AttachVolumeTestJSON-462274605 None] attachment_update completed successfully. Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-2758eea6-8d67-4464-9db8-6ec445ac27ca-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-2758eea6-8d67-4464-9db8-6ec445ac27ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-2758eea6-8d67-4464-9db8-6ec445ac27ca" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-2758eea6-8d67-4464-9db8-6ec445ac27ca" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Deleting offline snapshot 2758eea6-8d67-4464-9db8-6ec445ac27ca of volume ecca801a-194e-45ee-8cca-bd84dc5ccd4a {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] snapshot_file for this snap is: volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f97a6-4f10-40f9-a542-1f8ec2f3a214]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:53 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca Jun 23 20:17:53 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:54 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca" returned: 0 in 0.850s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:54 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:17:54 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88bc077-380e-4827-8ac1-081f5d922f83]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:17:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:54 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a Jun 23 20:17:54 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:55 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" returned: 0 in 0.962s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:55 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca Jun 23 20:17:55 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:56 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca" returned: 0 in 0.787s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:56 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca Jun 23 20:17:56 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:17:57 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jun 23 20:17:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a.2758eea6-8d67-4464-9db8-6ec445ac27ca" returned: 0 in 0.643s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:17:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-2758eea6-8d67-4464-9db8-6ec445ac27ca" released by "_delete_snapshot" :: held 3.364s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" released by "delete_snapshot" :: held 3.393s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:57 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Created reservations ['e3242d3e-4f07-46ed-b696-c71a79b1c4e0', 'd0b89f6e-9e83-4828-af0b-cb3e7620b297', '9871ca0a-9346-4517-9a58-18286c59c782', '63923fbd-d3af-4700-aaf9-84c02cf72545'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:17:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Delete snapshot completed successfully. Jun 23 20:17:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-581287a3-79a9-4dd0-a938-525dbbabf06d tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-2758eea6-8d67-4464-9db8-6ec445ac27ca-delete_snapshot" released by "delete_snapshot" :: held 3.569s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:17:58 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:17:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (ff7f4f97-cbf0-47cc-abc2-a647212a4ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:17:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d938ec5d-2b45-4627-96e4-3ed05a304713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d938ec5d-2b45-4627-96e4-3ed05a304713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-48472002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e84c8b-1b0a-4279-aa36-23fe3086d78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39427117a6c445391715694114417be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:17:59Z,use_quota=True,user_id='b0a9646b11274cc4b2025ac02512421f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8633c7f6-d8ec-4b5a-946b-8f3d7e63d69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8633c7f6-d8ec-4b5a-946b-8f3d7e63d69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8d1f0a-0130-4594-ac5d-e435d8114449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8d1f0a-0130-4594-ac5d-e435d8114449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e84c8b-1b0a-4279-aa36-23fe3086d78f', 'volume_name': 'volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0582717-8e5b-41bc-9ad9-754525ea97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0582717-8e5b-41bc-9ad9-754525ea97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e83a23-7016-4d30-9acc-bcdd14726ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:17:59 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Volume 91e84c8b-1b0a-4279-aa36-23fe3086d78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f', 'volume_size': 1} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-48472002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e84c8b-1b0a-4279-aa36-23fe3086d78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39427117a6c445391715694114417be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:17:59Z,use_quota=True,user_id='b0a9646b11274cc4b2025ac02512421f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Creating volume 91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:17:59 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:17:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:17:59 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f 1073741824 Jun 23 20:17:59 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:00 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f 1073741824" returned: 0 in 1.021s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:00 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f Jun 23 20:18:00 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:01 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f" returned: 0 in 1.022s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:18:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e83a23-7016-4d30-9acc-bcdd14726ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbd80ed-bc6b-495f-ac11-c5d70cf70a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:01 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Volume volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f (91e84c8b-1b0a-4279-aa36-23fe3086d78f): created successfully Jun 23 20:18:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbd80ed-bc6b-495f-ac11-c5d70cf70a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (ff7f4f97-cbf0-47cc-abc2-a647212a4ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-cc904f3d-0a73-48ce-88f2-c9718836d792 tempest-VolumesSnapshotTestJSON-1664657091 None] Created volume successfully. Jun 23 20:18:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Creating offline snapshot baa3081b-4984-4288-8748-0f1874725c7e of volume 91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:18:02 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cffa788-cc53-4784-9cc9-fe2c608ae0ce]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:02 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f Jun 23 20:18:02 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:03 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f" returned: 0 in 0.873s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:03 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e 1G Jun 23 20:18:03 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Flow 'volume_create_manager' (89759f4c-2a3e-491d-a1af-4bca1ae384a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25700b1-1de2-4101-a9e7-3937f909f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25700b1-1de2-4101-a9e7-3937f909f3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-628383579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ad405e-043f-45ce-8f34-052128b448a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d15a643b4a45c9b6d54de91a50f2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:04Z,use_quota=True,user_id='0889b9352dc44507b3775e4d199edeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e1e987-df22-41c1-b56c-288eace9ac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e1e987-df22-41c1-b56c-288eace9ac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ca2d24-4411-41dd-aa14-2df9a16a676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ca2d24-4411-41dd-aa14-2df9a16a676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ad405e-043f-45ce-8f34-052128b448a3', 'volume_name': 'volume-36ad405e-043f-45ce-8f34-052128b448a3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491c5a2a-ba4f-4ae8-8465-6b4612ae398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491c5a2a-ba4f-4ae8-8465-6b4612ae398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbc1058-ad95-41d5-833d-8044b13e8dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:03 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Volume 36ad405e-043f-45ce-8f34-052128b448a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ad405e-043f-45ce-8f34-052128b448a3', 'volume_size': 1} Jun 23 20:18:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=64,cinder:UPDATE=62,cinder:INSERT=8,cinder:DELETE=3 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:18:04 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Flow 'volume_create_manager' (3b2e4e14-7439-4095-b463-53b3b0209984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66444671-033a-42f3-b57f-21ecd50d6082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e 1G" returned: 0 in 1.080s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:04 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e Jun 23 20:18:04 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66444671-033a-42f3-b57f-21ecd50d6082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-395117513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a22c832-5b10-4761-868f-c39a1107149d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dfd3ff6c70a4fd8b4c450fd58c895db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:04Z,use_quota=True,user_id='361c06fe772e46309e0ceae396dca7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529a651a-6e7f-4e0a-939b-7c2589d7ea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529a651a-6e7f-4e0a-939b-7c2589d7ea79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968528f1-1c5c-4e9d-8e08-b87f3d36cc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968528f1-1c5c-4e9d-8e08-b87f3d36cc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a22c832-5b10-4761-868f-c39a1107149d', 'volume_name': 'volume-6a22c832-5b10-4761-868f-c39a1107149d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddece13-5ffb-4372-b569-96756abbb4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddece13-5ffb-4372-b569-96756abbb4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf866b6-ba8c-450f-a43b-80dac2437e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:04 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Volume 6a22c832-5b10-4761-868f-c39a1107149d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a22c832-5b10-4761-868f-c39a1107149d', 'volume_size': 1} Jun 23 20:18:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:05 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e" returned: 0 in 0.726s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:05 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e is being set with open permissions: ugo+rw Jun 23 20:18:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:05 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e Jun 23 20:18:05 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:05 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e" returned: 0 in 0.726s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:05 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.info Jun 23 20:18:05 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:06 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.info" returned: 0 in 0.648s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:06 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.info is being set with open permissions: ugo+rw Jun 23 20:18:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:06 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.info Jun 23 20:18:06 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:07 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.info" returned: 0 in 0.639s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.819s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.282s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-628383579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ad405e-043f-45ce-8f34-052128b448a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d15a643b4a45c9b6d54de91a50f2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:04Z,use_quota=True,user_id='0889b9352dc44507b3775e4d199edeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Creating volume 36ad405e-043f-45ce-8f34-052128b448a3 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:18:07 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:18:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:07 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 1073741824 Jun 23 20:18:07 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:07 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ea37924b-67d0-4adf-b82a-2114b8f072a9 tempest-VolumesSnapshotTestJSON-1664657091 None] Create snapshot completed successfully Jun 23 20:18:08 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 1073741824" returned: 0 in 1.009s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:08 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 Jun 23 20:18:08 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (2f07d8f8-b847-4b14-869d-7baf3e4e31fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07dcce8f-dded-48f3-b612-5ad2b840d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07dcce8f-dded-48f3-b612-5ad2b840d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-964407230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4850585-7b49-45d1-b2f9-729fbfdc1679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39427117a6c445391715694114417be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=baa3081b-4984-4288-8748-0f1874725c7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:08Z,use_quota=True,user_id='b0a9646b11274cc4b2025ac02512421f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc32a570-355a-4230-b528-078d368836ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc32a570-355a-4230-b528-078d368836ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b8d4dd-0780-46e5-9aac-d89f44881a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b8d4dd-0780-46e5-9aac-d89f44881a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4850585-7b49-45d1-b2f9-729fbfdc1679', 'volume_name': 'volume-d4850585-7b49-45d1-b2f9-729fbfdc1679', 'volume_size': 2, 'snapshot_id': 'baa3081b-4984-4288-8748-0f1874725c7e'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bb1231-a11f-49fb-908b-a9712f7b4f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bb1231-a11f-49fb-908b-a9712f7b4f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb9471a-880c-4c10-b667-c2b74e85f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:08 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Volume d4850585-7b49-45d1-b2f9-729fbfdc1679: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4850585-7b49-45d1-b2f9-729fbfdc1679', 'volume_size': 2, 'snapshot_id': 'baa3081b-4984-4288-8748-0f1874725c7e'} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:08 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3" returned: 0 in 0.650s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.491s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-395117513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a22c832-5b10-4761-868f-c39a1107149d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dfd3ff6c70a4fd8b4c450fd58c895db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:04Z,use_quota=True,user_id='361c06fe772e46309e0ceae396dca7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Creating volume 6a22c832-5b10-4761-868f-c39a1107149d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:18:08 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:08 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d 1073741824 Jun 23 20:18:08 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbc1058-ad95-41d5-833d-8044b13e8dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ad405e-043f-45ce-8f34-052128b448a3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5a222a-15dc-4feb-8629-c98cbb2dac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:08 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Volume volume-36ad405e-043f-45ce-8f34-052128b448a3 (36ad405e-043f-45ce-8f34-052128b448a3): created successfully Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5a222a-15dc-4feb-8629-c98cbb2dac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Flow 'volume_create_manager' (89759f4c-2a3e-491d-a1af-4bca1ae384a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-361eeb52-f6c8-4b94-835c-35b1857db3ac tempest-VolumeQuotasAdminTestJSON-1434463005 None] Created volume successfully. Jun 23 20:18:09 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d 1073741824" returned: 0 in 0.808s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:09 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d Jun 23 20:18:09 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Acquiring lock "cinder-36ad405e-043f-45ce-8f34-052128b448a3-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "cinder-36ad405e-043f-45ce-8f34-052128b448a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Acquiring lock "cinder-quobyte-36ad405e-043f-45ce-8f34-052128b448a3" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "cinder-quobyte-36ad405e-043f-45ce-8f34-052128b448a3" acquired by "delete_volume" :: waited 0.014s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0cc644-bd58-48e1-b7f1-9be6e8a4f41c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:10 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 Jun 23 20:18:10 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:10 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d" returned: 0 in 0.685s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.083s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-baa3081b-4984-4288-8748-0f1874725c7e-d4850585-7b49-45d1-b2f9-729fbfdc1679" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf866b6-ba8c-450f-a43b-80dac2437e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a22c832-5b10-4761-868f-c39a1107149d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4d4cbf-9cac-48bf-8d0b-e6b900774b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-baa3081b-4984-4288-8748-0f1874725c7e-d4850585-7b49-45d1-b2f9-729fbfdc1679" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Creating volume d4850585-7b49-45d1-b2f9-729fbfdc1679 from snapshot baa3081b-4984-4288-8748-0f1874725c7e {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-d4850585-7b49-45d1-b2f9-729fbfdc1679" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:10 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Volume volume-6a22c832-5b10-4761-868f-c39a1107149d (6a22c832-5b10-4761-868f-c39a1107149d): created successfully Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4d4cbf-9cac-48bf-8d0b-e6b900774b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Flow 'volume_create_manager' (3b2e4e14-7439-4095-b463-53b3b0209984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-d4850585-7b49-45d1-b2f9-729fbfdc1679" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] snapshot: baa3081b-4984-4288-8748-0f1874725c7e, volume: d4850585-7b49-45d1-b2f9-729fbfdc1679, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:18:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2ac6890d-ccf7-4e4b-aa53-85684421b535 tempest-AttachVolumeShelveTestJSON-638918666 None] Created volume successfully. Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f33fe-7cc4-4c0e-bfc7-dd2826dc8538]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:10 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e Jun 23 20:18:10 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:11 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3" returned: 0 in 0.956s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:11 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3 Jun 23 20:18:11 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:11 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e" returned: 0 in 0.992s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:18:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:18:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:18:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[187b17e4-299a-41b8-bc34-539c1238e868]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:11 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f Jun 23 20:18:11 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:12 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36ad405e-043f-45ce-8f34-052128b448a3" returned: 0 in 0.989s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "cinder-quobyte-36ad405e-043f-45ce-8f34-052128b448a3" released by "delete_volume" :: held 2.003s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Created reservations ['fad96035-5862-410e-9566-ecd0717b9da1', '2186f35f-5e25-4b2c-94bd-af5200ce7627', 'fd48cede-8cc2-4248-865d-8ca27393e7d1', '5d603824-be10-4290-863c-86c2ef0bd1d9'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:12 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:18:12 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:13 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f" returned: 0 in 1.531s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:13 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:18:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:13 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 Jun 23 20:18:13 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:13 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.940s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:13 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:18:13 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Deleted volume successfully. Jun 23 20:18:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0468c94d-08dc-4f0f-aa31-2af34b9a00ce tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "cinder-36ad405e-043f-45ce-8f34-052128b448a3-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Flow 'volume_create_manager' (1b9d66e2-bc08-470c-98f9-60e3744a11fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df412bdb-4adb-495a-bbd4-55409add1271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df412bdb-4adb-495a-bbd4-55409add1271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-590579060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f54df02-aa4e-4b01-acf1-eef4665bc2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d15a643b4a45c9b6d54de91a50f2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:15Z,use_quota=True,user_id='0889b9352dc44507b3775e4d199edeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0199dc27-729d-4f55-8e49-34129d2ab4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0199dc27-729d-4f55-8e49-34129d2ab4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5276607f-f11c-45ab-b0e1-52916bbc8ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5276607f-f11c-45ab-b0e1-52916bbc8ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f54df02-aa4e-4b01-acf1-eef4665bc2bf', 'volume_name': 'volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e63352-f9ee-424d-8ad5-9cfa8086542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e63352-f9ee-424d-8ad5-9cfa8086542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cbbbc7-4e0d-4925-9f71-1d0da091606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Volume 5f54df02-aa4e-4b01-acf1-eef4665bc2bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf', 'volume_size': 1} Jun 23 20:18:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:21 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679" returned: 0 in 8.358s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:21 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb5e98-0c9b-484d-a229-dfab3fc2ba58]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:21 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f Jun 23 20:18:21 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:22 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f" returned: 0 in 1.130s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:22 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:18:22 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Converted 1024.00 MB image at 122.48 MB/s Jun 23 20:18:22 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 is being set with open permissions: ugo+rw Jun 23 20:18:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:22 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 Jun 23 20:18:22 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:23 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679" returned: 0 in 0.889s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-d4850585-7b49-45d1-b2f9-729fbfdc1679" released by "_copy_volume_from_snapshot" :: held 13.054s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-baa3081b-4984-4288-8748-0f1874725c7e-d4850585-7b49-45d1-b2f9-729fbfdc1679" released by "_create_volume_from_snapshot" :: held 13.116s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.156s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.590s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-590579060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f54df02-aa4e-4b01-acf1-eef4665bc2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d15a643b4a45c9b6d54de91a50f2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:15Z,use_quota=True,user_id='0889b9352dc44507b3775e4d199edeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Creating volume 5f54df02-aa4e-4b01-acf1-eef4665bc2bf {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:18:23 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:23 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf 1073741824 Jun 23 20:18:23 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb9471a-880c-4c10-b667-c2b74e85f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4850585-7b49-45d1-b2f9-729fbfdc1679', 'volume_size': 2, 'snapshot_id': 'baa3081b-4984-4288-8748-0f1874725c7e'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632bff60-64b7-4715-b0a7-f54bbf6a4af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:23 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Volume volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 (d4850585-7b49-45d1-b2f9-729fbfdc1679): created successfully Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632bff60-64b7-4715-b0a7-f54bbf6a4af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (2f07d8f8-b847-4b14-869d-7baf3e4e31fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:23 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0cdd7ce1-2531-451b-b277-e79a50cafc4c tempest-VolumesSnapshotTestJSON-1664657091 None] Created volume successfully. Jun 23 20:18:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-d4850585-7b49-45d1-b2f9-729fbfdc1679-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-d4850585-7b49-45d1-b2f9-729fbfdc1679-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-d4850585-7b49-45d1-b2f9-729fbfdc1679" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-d4850585-7b49-45d1-b2f9-729fbfdc1679" acquired by "delete_volume" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:24 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c61017-3a9c-4f74-a9fd-f89ad4673cbf]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:24 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 Jun 23 20:18:24 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:24 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf 1073741824" returned: 0 in 0.974s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:24 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf Jun 23 20:18:24 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:25 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679" returned: 0 in 0.826s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:25 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679 Jun 23 20:18:25 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:25 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf" returned: 0 in 0.756s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cbbbc7-4e0d-4925-9f71-1d0da091606a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95011104-009d-478e-b4cc-6ffefe4ca11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:25 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Volume volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf (5f54df02-aa4e-4b01-acf1-eef4665bc2bf): created successfully Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95011104-009d-478e-b4cc-6ffefe4ca11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Flow 'volume_create_manager' (1b9d66e2-bc08-470c-98f9-60e3744a11fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-10443d5d-a8a3-421d-a1cc-5e1174f22509 tempest-VolumeQuotasAdminTestJSON-1434463005 None] Created volume successfully. Jun 23 20:18:25 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4850585-7b49-45d1-b2f9-729fbfdc1679" returned: 0 in 0.698s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-d4850585-7b49-45d1-b2f9-729fbfdc1679" released by "delete_volume" :: held 1.577s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:25 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Created reservations ['1a5fc761-fd47-4ed7-ad88-0f0dc67db9d8', 'c3643eef-7552-43b3-b09d-4b4071b63976', '03586d07-a37c-46cd-99f1-ac217651cf94', 'd7d7edde-698e-48dd-918d-1e12cd7fd655'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:26 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:18:26 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-baa3081b-4984-4288-8748-0f1874725c7e-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-baa3081b-4984-4288-8748-0f1874725c7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-91e84c8b-1b0a-4279-aa36-23fe3086d78f" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-91e84c8b-1b0a-4279-aa36-23fe3086d78f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-baa3081b-4984-4288-8748-0f1874725c7e" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-baa3081b-4984-4288-8748-0f1874725c7e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Deleting offline snapshot baa3081b-4984-4288-8748-0f1874725c7e of volume 91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] snapshot_file for this snap is: volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a771648c-289f-49e1-b80b-69655fc00d1e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:27 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e Jun 23 20:18:27 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:27 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.025s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:27 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:18:27 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Deleted volume successfully. Jun 23 20:18:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50ebbbfe-ba79-4a67-be9d-bf5d6fb6b76e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-d4850585-7b49-45d1-b2f9-729fbfdc1679-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:27 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-6bd9c40d-c577-420b-9066-4b2008814de9 tempest-VolumeQuotasAdminTestJSON-1937090531 None] Transfer volume completed successfully. Jun 23 20:18:28 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e" returned: 0 in 1.087s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f642a16-4dda-4677-95dc-191ac130998e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:28 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f Jun 23 20:18:28 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Acquiring lock "cinder-5f54df02-aa4e-4b01-acf1-eef4665bc2bf-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Lock "cinder-5f54df02-aa4e-4b01-acf1-eef4665bc2bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Acquiring lock "cinder-quobyte-5f54df02-aa4e-4b01-acf1-eef4665bc2bf" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Lock "cinder-quobyte-5f54df02-aa4e-4b01-acf1-eef4665bc2bf" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ce26ca-074e-41f0-bad1-2c458966c1a0]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:28 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf Jun 23 20:18:28 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:28 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f" returned: 0 in 0.938s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:29 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e Jun 23 20:18:29 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:29 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf" returned: 0 in 0.953s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:29 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf Jun 23 20:18:29 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:29 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e" returned: 0 in 0.851s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:29 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e Jun 23 20:18:29 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-30888613-e280-4975-93fc-860aed06d980 req-58e5eb53-7575-4a89-af88-aab8903a0102 tempest-AttachVolumeShelveTestJSON-638918666 None] No connector for attachment 8fd0b14d-2128-4094-9bd2-490ba2ad4695; skipping storage backend terminate_connection call. {{(pid=93739) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-30888613-e280-4975-93fc-860aed06d980 req-58e5eb53-7575-4a89-af88-aab8903a0102 tempest-AttachVolumeShelveTestJSON-638918666 None] Deleting attachment 8fd0b14d-2128-4094-9bd2-490ba2ad4695. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:18:30 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5f54df02-aa4e-4b01-acf1-eef4665bc2bf" returned: 0 in 0.790s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:30 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f.baa3081b-4984-4288-8748-0f1874725c7e" returned: 0 in 0.709s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Lock "cinder-quobyte-5f54df02-aa4e-4b01-acf1-eef4665bc2bf" released by "delete_volume" :: held 1.810s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-baa3081b-4984-4288-8748-0f1874725c7e" released by "_delete_snapshot" :: held 3.726s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-91e84c8b-1b0a-4279-aa36-23fe3086d78f" released by "delete_snapshot" :: held 3.774s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Created reservations ['9511b81c-db09-4ee0-81bf-3802d24bd524', 'd61a2ac1-f48f-45d0-845c-74d752c35124', '7779f8d1-bebe-443a-aef7-a167134da833', 'a8d634b7-d2b5-4a70-9a14-106a8792426b'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Created reservations ['f3b28def-eb20-490d-9d83-2c25f04ba745', '9acec632-9021-4d95-b68b-690df603f3fb', '74c855f6-1f8b-4e88-b6ae-fb9b387e1aac', '5b46eadf-5fe6-4bf9-aef9-880c035da43d'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:30 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:18:30 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:30 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Delete snapshot completed successfully. Jun 23 20:18:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a911a37d-0687-4302-8373-17fdb05bf7d0 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-baa3081b-4984-4288-8748-0f1874725c7e-delete_snapshot" released by "delete_snapshot" :: held 4.050s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-91e84c8b-1b0a-4279-aa36-23fe3086d78f-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-91e84c8b-1b0a-4279-aa36-23fe3086d78f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-91e84c8b-1b0a-4279-aa36-23fe3086d78f" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-91e84c8b-1b0a-4279-aa36-23fe3086d78f" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb4d728-2518-477c-a0dd-51d4c28bd8cb]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:31 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f Jun 23 20:18:31 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:31 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.011s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:18:31 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Deleted volume successfully. Jun 23 20:18:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ec471e06-8f8a-4634-a165-dbfddedd451d tempest-VolumeQuotasAdminTestJSON-1952625333 None] Lock "cinder-5f54df02-aa4e-4b01-acf1-eef4665bc2bf-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:32 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f" returned: 0 in 1.006s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:32 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f Jun 23 20:18:32 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:33 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91e84c8b-1b0a-4279-aa36-23fe3086d78f" returned: 0 in 0.800s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-91e84c8b-1b0a-4279-aa36-23fe3086d78f" released by "delete_volume" :: held 1.928s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Created reservations ['6c3da6a9-2569-411c-9cf6-81cb0248db6f', 'e6117a08-f283-41bc-8d11-03321ece96d9', '66f82b44-5f18-40d2-96e2-1c4d3dfc925c', '4a4b1e83-cb24-4406-a616-9895e11f2f56'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:33 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:18:33 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.984s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:18:34 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Deleted volume successfully. Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b604a48c-ff88-4623-aa9d-7b8c84d69a54 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-91e84c8b-1b0a-4279-aa36-23fe3086d78f-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (4c5dd791-7ca1-41f2-ba11-40751d1faf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ac0b8c-846e-41f3-a500-af095ce193ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ac0b8c-846e-41f3-a500-af095ce193ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1195892057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b757e325-9acb-472d-9700-332386c7c2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39427117a6c445391715694114417be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:35Z,use_quota=True,user_id='b0a9646b11274cc4b2025ac02512421f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ea19ad-3736-476f-aeb9-65fcf44e15c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ea19ad-3736-476f-aeb9-65fcf44e15c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e308d47-23f5-4858-90bf-f3cb2f615610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e308d47-23f5-4858-90bf-f3cb2f615610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b757e325-9acb-472d-9700-332386c7c2da', 'volume_name': 'volume-b757e325-9acb-472d-9700-332386c7c2da', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ddeab-c9ed-4a05-a1f5-10ffe525e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ddeab-c9ed-4a05-a1f5-10ffe525e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a953528e-7b6e-40bf-953e-4b9b508de9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Volume b757e325-9acb-472d-9700-332386c7c2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b757e325-9acb-472d-9700-332386c7c2da', 'volume_size': 1} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1195892057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b757e325-9acb-472d-9700-332386c7c2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39427117a6c445391715694114417be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:35Z,use_quota=True,user_id='b0a9646b11274cc4b2025ac02512421f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Creating volume b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:18:34 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:18:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:34 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da 1073741824 Jun 23 20:18:34 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:35 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da 1073741824" returned: 0 in 1.050s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:36 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da Jun 23 20:18:36 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:36 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da" returned: 0 in 0.695s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:18:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a953528e-7b6e-40bf-953e-4b9b508de9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b757e325-9acb-472d-9700-332386c7c2da', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9d97d3-6395-4681-bc94-30632fdce417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Volume volume-b757e325-9acb-472d-9700-332386c7c2da (b757e325-9acb-472d-9700-332386c7c2da): created successfully Jun 23 20:18:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9d97d3-6395-4681-bc94-30632fdce417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (4c5dd791-7ca1-41f2-ba11-40751d1faf47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:36 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=93,cinder:SELECT=90,cinder:INSERT=24,cinder:DELETE=5 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:18:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d5e529a3-fb1e-4db1-8aff-0f1904b64023 tempest-VolumesSnapshotTestJSON-1664657091 None] Created volume successfully. Jun 23 20:18:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Creating offline snapshot 14ac8519-6ed0-412d-807b-384d5d29e977 of volume b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:18:38 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf95e534-d7a0-4c22-868b-d0f71ec18bcf]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:38 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da Jun 23 20:18:38 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:38 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da" returned: 0 in 0.884s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:38 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 1G Jun 23 20:18:38 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:39 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-cab6cc7a-2656-488b-a891-2f5030b2723c req-231358ec-473d-4ae5-bec8-1269aab1d4ff tempest-AttachVolumeTestJSON-462274605 None] Terminate volume connection completed successfully. Jun 23 20:18:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-cab6cc7a-2656-488b-a891-2f5030b2723c req-231358ec-473d-4ae5-bec8-1269aab1d4ff tempest-AttachVolumeTestJSON-462274605 None] Deleting attachment d7b677b7-573e-4f19-ac51-6be7bf5bdd91. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:18:39 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 1G" returned: 0 in 1.054s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b757e325-9acb-472d-9700-332386c7c2da -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:39 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b757e325-9acb-472d-9700-332386c7c2da -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 Jun 23 20:18:39 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Flow 'volume_create_manager' (da0d25ba-25e7-4c32-b9e9-4bb63c2b3f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4faffec-4c63-443a-93a2-2cf466117e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4faffec-4c63-443a-93a2-2cf466117e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1786079159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb013c1-ed9d-490c-918e-6b5d0d69b8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be98e0130c4c493bbe20d560090345bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:40Z,use_quota=True,user_id='1ada0f9be53749869740008c341579b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848bb29d-efde-4f23-88d7-16095946425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848bb29d-efde-4f23-88d7-16095946425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f78127-81ae-491b-8cf6-3f68805c1b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f78127-81ae-491b-8cf6-3f68805c1b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb013c1-ed9d-490c-918e-6b5d0d69b8bc', 'volume_name': 'volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e24e1e-3574-42ca-bccf-d02527d654c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e24e1e-3574-42ca-bccf-d02527d654c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e7a66f-38f0-47be-be55-052a8666bde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:40 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Volume 4cb013c1-ed9d-490c-918e-6b5d0d69b8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc', 'volume_size': 1} Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:40 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b757e325-9acb-472d-9700-332386c7c2da -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977" returned: 0 in 0.772s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:40 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 is being set with open permissions: ugo+rw Jun 23 20:18:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:40 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 Jun 23 20:18:40 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:41 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977" returned: 0 in 0.660s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:41 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.info Jun 23 20:18:41 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:42 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.info" returned: 0 in 0.721s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:42 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.info is being set with open permissions: ugo+rw Jun 23 20:18:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:42 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.info Jun 23 20:18:42 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:43 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.info" returned: 0 in 1.058s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.250s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.702s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1786079159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb013c1-ed9d-490c-918e-6b5d0d69b8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be98e0130c4c493bbe20d560090345bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:40Z,use_quota=True,user_id='1ada0f9be53749869740008c341579b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Creating volume 4cb013c1-ed9d-490c-918e-6b5d0d69b8bc {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:18:43 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:18:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:43 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc 1073741824 Jun 23 20:18:43 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-07d6b7bf-cda0-4fb8-8553-4751cc686536 tempest-VolumesSnapshotTestJSON-1664657091 None] Create snapshot completed successfully Jun 23 20:18:44 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc 1073741824" returned: 0 in 0.929s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:44 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc Jun 23 20:18:44 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (295bcb16-6a19-4b8e-9f80-704faea10a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:45 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9adb94a6-1ba8-471c-b005-4ece4ce3b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" returned: 0 in 0.973s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9adb94a6-1ba8-471c-b005-4ece4ce3b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1966047496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c00013-05af-418a-a98c-4c3a46beae03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39427117a6c445391715694114417be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14ac8519-6ed0-412d-807b-384d5d29e977,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:18:45Z,use_quota=True,user_id='b0a9646b11274cc4b2025ac02512421f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8732e0-6734-4291-8da5-432d634b1ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8732e0-6734-4291-8da5-432d634b1ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f8716a-456a-47f5-b15a-ed0f944f35e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f8716a-456a-47f5-b15a-ed0f944f35e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '80c00013-05af-418a-a98c-4c3a46beae03', 'volume_name': 'volume-80c00013-05af-418a-a98c-4c3a46beae03', 'volume_size': 1, 'snapshot_id': '14ac8519-6ed0-412d-807b-384d5d29e977'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2791814a-ddcc-4d33-a7ec-387b42729a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2791814a-ddcc-4d33-a7ec-387b42729a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f632d380-bfc7-4576-94bc-702cc40aa7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:45 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Volume 80c00013-05af-418a-a98c-4c3a46beae03: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-80c00013-05af-418a-a98c-4c3a46beae03', 'volume_size': 1, 'snapshot_id': '14ac8519-6ed0-412d-807b-384d5d29e977'} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-14ac8519-6ed0-412d-807b-384d5d29e977-80c00013-05af-418a-a98c-4c3a46beae03" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e7a66f-38f0-47be-be55-052a8666bde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d71658-a01a-48dd-904a-a3416859d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-14ac8519-6ed0-412d-807b-384d5d29e977-80c00013-05af-418a-a98c-4c3a46beae03" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Creating volume 80c00013-05af-418a-a98c-4c3a46beae03 from snapshot 14ac8519-6ed0-412d-807b-384d5d29e977 {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-80c00013-05af-418a-a98c-4c3a46beae03" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:45 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Volume volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc (4cb013c1-ed9d-490c-918e-6b5d0d69b8bc): created successfully Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d71658-a01a-48dd-904a-a3416859d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Flow 'volume_create_manager' (da0d25ba-25e7-4c32-b9e9-4bb63c2b3f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-80c00013-05af-418a-a98c-4c3a46beae03" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] snapshot: 14ac8519-6ed0-412d-807b-384d5d29e977, volume: 80c00013-05af-418a-a98c-4c3a46beae03, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:18:45 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-efb88069-c990-4be9-ad01-716f4bdc363c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Created volume successfully. Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1adfb8-d877-47f4-8313-9a02d9fd9345]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:45 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 Jun 23 20:18:45 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:46 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977" returned: 0 in 0.908s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b757e325-9acb-472d-9700-332386c7c2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72a9eb7-9a6c-4ecf-85cf-f6b5f8d98bff]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:46 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da Jun 23 20:18:46 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:46 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:18:46 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:47 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da" returned: 0 in 0.912s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:47 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:18:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:47 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 Jun 23 20:18:47 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:47 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.853s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:18:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:18:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:18:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:18:53 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03" returned: 0 in 6.493s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:53 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c47ee7-3bbc-40a8-805b-045543eb6f90]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:53 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da Jun 23 20:18:53 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:55 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da" returned: 0 in 1.279s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:55 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:18:55 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Converted 1024.00 MB image at 157.66 MB/s Jun 23 20:18:55 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 is being set with open permissions: ugo+rw Jun 23 20:18:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:55 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 Jun 23 20:18:55 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=43,cinder:UPDATE=54,cinder:INSERT=13,cinder:DELETE=9 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:18:56 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03" returned: 0 in 1.528s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-80c00013-05af-418a-a98c-4c3a46beae03" released by "_copy_volume_from_snapshot" :: held 11.280s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-14ac8519-6ed0-412d-807b-384d5d29e977-80c00013-05af-418a-a98c-4c3a46beae03" released by "_create_volume_from_snapshot" :: held 11.328s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.360s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.578s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Creating offline snapshot a1696313-3e04-4624-9585-b052b511e6ae of volume 4cb013c1-ed9d-490c-918e-6b5d0d69b8bc {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f632d380-bfc7-4576-94bc-702cc40aa7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c00013-05af-418a-a98c-4c3a46beae03', 'volume_size': 1, 'snapshot_id': '14ac8519-6ed0-412d-807b-384d5d29e977'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cb3b27-e7e5-4826-855c-a9c6f2ba413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f527d2ab-0cfa-41b2-9c19-a09806643236]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:56 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Volume volume-80c00013-05af-418a-a98c-4c3a46beae03 (80c00013-05af-418a-a98c-4c3a46beae03): created successfully Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cb3b27-e7e5-4826-855c-a9c6f2ba413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:18:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Flow 'volume_create_manager' (295bcb16-6a19-4b8e-9f80-704faea10a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:18:56 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-11d08063-bac6-4bb4-8de5-bc4a0335962b tempest-VolumesSnapshotTestJSON-1664657091 None] Created volume successfully. Jun 23 20:18:56 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc Jun 23 20:18:56 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-80c00013-05af-418a-a98c-4c3a46beae03-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-80c00013-05af-418a-a98c-4c3a46beae03-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:58 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" returned: 0 in 1.210s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:58 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae 1G Jun 23 20:18:58 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-80c00013-05af-418a-a98c-4c3a46beae03" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:18:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-80c00013-05af-418a-a98c-4c3a46beae03" acquired by "delete_volume" :: waited 0.057s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:18:58 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b9c31-c9d6-486b-8bbd-3bd5d05236cd]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:18:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:58 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 Jun 23 20:18:58 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:18:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae 1G" returned: 0 in 1.469s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:18:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:18:59 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jun 23 20:18:59 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae Jun 23 20:18:59 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:00 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03" returned: 0 in 1.998s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:00 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03 Jun 23 20:19:00 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:00 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae" returned: 0 in 1.173s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:00 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae is being set with open permissions: ugo+rw Jun 23 20:19:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:00 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae Jun 23 20:19:00 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:01 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-80c00013-05af-418a-a98c-4c3a46beae03" returned: 0 in 1.306s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-80c00013-05af-418a-a98c-4c3a46beae03" released by "delete_volume" :: held 3.426s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:01 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae" returned: 0 in 1.017s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Created reservations ['e7f47994-e644-4989-a4a1-f2a4f2510a93', '79c06e56-92d4-4e85-91d6-b91eafb16ef6', '5695abab-4130-4b2a-9771-24e2f75a00b1', '9690627a-35fb-4e01-ad82-2cd235b1ad80'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:01 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.info Jun 23 20:19:01 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:01 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:01 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:02 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.723s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Deleted volume successfully. Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0710075a-bcaa-4d80-8e4d-63d5aac1230e tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-80c00013-05af-418a-a98c-4c3a46beae03-delete_volume" released by "delete_volume" :: held 4.628s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:02 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.info" returned: 0 in 1.013s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:02 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.info is being set with open permissions: ugo+rw Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-14ac8519-6ed0-412d-807b-384d5d29e977-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:02 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.info Jun 23 20:19:02 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-14ac8519-6ed0-412d-807b-384d5d29e977-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-b757e325-9acb-472d-9700-332386c7c2da" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-b757e325-9acb-472d-9700-332386c7c2da" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-14ac8519-6ed0-412d-807b-384d5d29e977" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-14ac8519-6ed0-412d-807b-384d5d29e977" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Deleting offline snapshot 14ac8519-6ed0-412d-807b-384d5d29e977 of volume b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] snapshot_file for this snap is: volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b9d743-151e-4001-90f7-72ca1db6718b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:03 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 Jun 23 20:19:03 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:03 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.info" returned: 0 in 0.800s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.925s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:03 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-565104f3-045f-4b6e-a04b-2bdd902c7e1e tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Create snapshot completed successfully Jun 23 20:19:03 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977" returned: 0 in 1.023s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b757e325-9acb-472d-9700-332386c7c2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:19:04 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[280d32ce-6130-4956-a366-221e97b62994]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:04 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da Jun 23 20:19:04 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:04 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da" returned: 0 in 0.850s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:04 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 Jun 23 20:19:04 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "cinder-a1696313-3e04-4624-9585-b052b511e6ae-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-a1696313-3e04-4624-9585-b052b511e6ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "cinder-quobyte-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-quobyte-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "cinder-quobyte-a1696313-3e04-4624-9585-b052b511e6ae" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-quobyte-a1696313-3e04-4624-9585-b052b511e6ae" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Deleting offline snapshot a1696313-3e04-4624-9585-b052b511e6ae of volume 4cb013c1-ed9d-490c-918e-6b5d0d69b8bc {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] snapshot_file for this snap is: volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00abbb-26dc-41cd-9c05-50a014be8671]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:05 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae Jun 23 20:19:05 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:05 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977" returned: 0 in 0.984s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:05 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977 Jun 23 20:19:05 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:06 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae" returned: 0 in 1.029s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[77021381-38c1-406d-87f1-3db8629a7600]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:06 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc Jun 23 20:19:06 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:06 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da.14ac8519-6ed0-412d-807b-384d5d29e977" returned: 0 in 0.842s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-14ac8519-6ed0-412d-807b-384d5d29e977" released by "_delete_snapshot" :: held 3.837s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-b757e325-9acb-472d-9700-332386c7c2da" released by "delete_snapshot" :: held 3.867s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Created reservations ['0df2ebbc-12f2-42a7-9ba3-4fef70ed312e', '09e10f99-36ee-4e75-8430-50dd00d9d3a2', '3cef72f9-f3bb-4429-b48d-22f9278647b0', 'f1287a05-8390-4012-8a2a-30cea2e484e4'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:06 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Delete snapshot completed successfully. Jun 23 20:19:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c97de66-48b6-4ffc-b2f8-545876cbc03c tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-14ac8519-6ed0-412d-807b-384d5d29e977-delete_snapshot" released by "delete_snapshot" :: held 4.100s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-b757e325-9acb-472d-9700-332386c7c2da-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:07 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" returned: 0 in 0.962s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-b757e325-9acb-472d-9700-332386c7c2da-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:07 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae Jun 23 20:19:07 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-b757e325-9acb-472d-9700-332386c7c2da" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-b757e325-9acb-472d-9700-332386c7c2da" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:07 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[29593677-dc67-4e50-a402-4c55b17ea33e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:07 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da Jun 23 20:19:07 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:08 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae" returned: 0 in 0.989s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:08 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae Jun 23 20:19:08 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:08 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da" returned: 0 in 0.921s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:08 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da Jun 23 20:19:08 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:09 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc.a1696313-3e04-4624-9585-b052b511e6ae" returned: 0 in 0.696s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-quobyte-a1696313-3e04-4624-9585-b052b511e6ae" released by "_delete_snapshot" :: held 3.805s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-quobyte-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" released by "delete_snapshot" :: held 3.846s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Created reservations ['10e0de7f-de75-4712-a653-a9bce5283bca', '13f6c6a6-a5c9-458d-a788-bc03cc869659', 'b4bbd248-d5b5-443e-9ad1-73c416fb1cfa', '54153669-b668-4bfc-a6e3-c781cc852348'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:09 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b757e325-9acb-472d-9700-332386c7c2da" returned: 0 in 0.783s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-b757e325-9acb-472d-9700-332386c7c2da" released by "delete_volume" :: held 1.781s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:09 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Delete snapshot completed successfully. Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bff13f17-e748-4204-b64f-fd0ba9fff1ea tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-a1696313-3e04-4624-9585-b052b511e6ae-delete_snapshot" released by "delete_snapshot" :: held 4.048s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Created reservations ['969cc419-255e-48ed-8ccb-f48044c462a2', '337fce90-5aed-443f-999d-d9d4854d3674', '398fb331-3f0f-407a-b509-f78e53cf28b8', '37894f66-80ac-48e7-8eda-6a4d2de00318'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:09 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:09 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "cinder-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "cinder-quobyte-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-quobyte-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f0e7a2-549a-4848-bef8-dffb48a9d504]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-ecca801a-194e-45ee-8cca-bd84dc5ccd4a-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-ecca801a-194e-45ee-8cca-bd84dc5ccd4a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "cinder-quobyte-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:10 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc Jun 23 20:19:10 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[621e9cae-fd03-417d-8d27-26feee03aa1e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:10 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.795s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Deleted volume successfully. Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-102d895f-a050-47d3-b7c8-45b8cf61fa49 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-b757e325-9acb-472d-9700-332386c7c2da-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:10 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a Jun 23 20:19:10 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:10 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" returned: 0 in 0.990s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:10 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc Jun 23 20:19:10 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:11 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" returned: 0 in 0.935s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:11 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a Jun 23 20:19:11 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:11 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" returned: 0 in 0.753s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-quobyte-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc" released by "delete_volume" :: held 1.828s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Created reservations ['fcb68e19-becf-4fe2-8f40-f42055a48939', 'e7739c7c-f527-43db-bcbd-151327eb45c4', 'af5fe69a-bf1f-4152-bfc2-a5447e9ac635', '3880b408-53ce-4d03-babf-33f366b692fd'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:11 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" returned: 0 in 0.725s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:11 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:11 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-quobyte-ecca801a-194e-45ee-8cca-bd84dc5ccd4a" released by "delete_volume" :: held 1.735s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Created reservations ['dee48100-e652-4026-a853-bacfd7910adf', 'c3d4d8d1-06b3-41e4-a754-6830cef452d9', '7e869249-d1e4-429c-8b69-ea304cce254f', '1492cdc1-5205-4139-9d0c-7f09a425cee7'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:11 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:11 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:12 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.799s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:12 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:12 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Deleted volume successfully. Jun 23 20:19:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4a689200-9e98-4452-bc7e-7bc68b591b9c tempest-VolumeSnapshotQuotasNegativeTestJSON-75915857 None] Lock "cinder-4cb013c1-ed9d-490c-918e-6b5d0d69b8bc-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:12 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.777s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:12 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:12 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Deleted volume successfully. Jun 23 20:19:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76e3b040-cae1-4d38-8825-55ef828832a3 tempest-VolumesSnapshotTestJSON-1664657091 None] Lock "cinder-ecca801a-194e-45ee-8cca-bd84dc5ccd4a-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Flow 'volume_create_manager' (fab11817-6ff2-4889-872a-d79243d582cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c45f375-324b-48a7-9cff-98424f1cf982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c45f375-324b-48a7-9cff-98424f1cf982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-376575805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f82411c-da4f-436e-bb53-2f33922ecd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0915a16a1f374da5b1ddb13773da7cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:20Z,use_quota=True,user_id='667a809d08ce4c0eb294b707f3344c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f97774-df13-4f6d-b23a-8672b9646d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f97774-df13-4f6d-b23a-8672b9646d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e7626d-fd59-45db-9e43-3dc786f9712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e7626d-fd59-45db-9e43-3dc786f9712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f82411c-da4f-436e-bb53-2f33922ecd2c', 'volume_name': 'volume-6f82411c-da4f-436e-bb53-2f33922ecd2c', 'volume_size': 2}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f9e4d1-cdd8-4a4c-b563-a99df37116a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f9e4d1-cdd8-4a4c-b563-a99df37116a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861100bb-1fef-43d1-a6f4-310e15c8dae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:19 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Volume 6f82411c-da4f-436e-bb53-2f33922ecd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f82411c-da4f-436e-bb53-2f33922ecd2c', 'volume_size': 2} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-376575805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f82411c-da4f-436e-bb53-2f33922ecd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0915a16a1f374da5b1ddb13773da7cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:20Z,use_quota=True,user_id='667a809d08ce4c0eb294b707f3344c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Creating volume 6f82411c-da4f-436e-bb53-2f33922ecd2c {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:19:19 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:19:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c 2147483648 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:19 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c 2147483648 Jun 23 20:19:19 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:21 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c 2147483648" returned: 0 in 1.195s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:21 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c Jun 23 20:19:21 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:21 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c" returned: 0 in 0.679s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861100bb-1fef-43d1-a6f4-310e15c8dae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f82411c-da4f-436e-bb53-2f33922ecd2c', 'volume_size': 2}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64586144-2e74-4e92-a65c-efc9c2554709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:21 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Volume volume-6f82411c-da4f-436e-bb53-2f33922ecd2c (6f82411c-da4f-436e-bb53-2f33922ecd2c): created successfully Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64586144-2e74-4e92-a65c-efc9c2554709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Flow 'volume_create_manager' (fab11817-6ff2-4889-872a-d79243d582cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-dd976fd3-f5f8-48b7-b4e7-292fb7747e07 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Created volume successfully. Jun 23 20:19:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Creating offline snapshot 1febd933-338e-4d15-8b10-4a1041134412 of volume 6f82411c-da4f-436e-bb53-2f33922ecd2c {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:19:23 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defb0c7-b596-454d-8173-19f54f8997ee]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:23 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c Jun 23 20:19:23 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:24 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c" returned: 0 in 0.906s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 2G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:24 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 2G Jun 23 20:19:24 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Flow 'volume_create_manager' (03f9a07d-b96d-4e45-85e6-e7c2f55a4406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d90c1ff-38e0-4d34-b74c-e04e42c0c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d90c1ff-38e0-4d34-b74c-e04e42c0c079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1403273556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc42717-da19-48ac-9676-adcdc0b23c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1237c0d9a334690ae1bd6ddf44ae83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:25Z,use_quota=True,user_id='ddf37a47ae5a4aecae1edb0ce3692b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0682e7-1a24-4dc1-9e75-ca136b012de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0682e7-1a24-4dc1-9e75-ca136b012de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5020c8fa-4c59-477b-aadf-807a23450c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5020c8fa-4c59-477b-aadf-807a23450c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc42717-da19-48ac-9676-adcdc0b23c44', 'volume_name': 'volume-afc42717-da19-48ac-9676-adcdc0b23c44', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d2d4bf-96bf-4a1d-8a80-e8f821e51b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d2d4bf-96bf-4a1d-8a80-e8f821e51b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4a26cd-d954-42bc-a299-cc1ac2d01150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:24 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Volume afc42717-da19-48ac-9676-adcdc0b23c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc42717-da19-48ac-9676-adcdc0b23c44', 'volume_size': 1} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:24 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 2G" returned: 0 in 0.932s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f82411c-da4f-436e-bb53-2f33922ecd2c -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:25 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f82411c-da4f-436e-bb53-2f33922ecd2c -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 Jun 23 20:19:25 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:25 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f82411c-da4f-436e-bb53-2f33922ecd2c -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412" returned: 0 in 0.670s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:25 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 is being set with open permissions: ugo+rw Jun 23 20:19:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:25 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 Jun 23 20:19:25 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:26 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412" returned: 0 in 0.643s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:26 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.info Jun 23 20:19:26 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:26 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.info" returned: 0 in 0.665s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:27 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.info is being set with open permissions: ugo+rw Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:27 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.info Jun 23 20:19:27 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:27 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.info" returned: 0 in 0.641s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.542s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.811s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1403273556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc42717-da19-48ac-9676-adcdc0b23c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1237c0d9a334690ae1bd6ddf44ae83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:25Z,use_quota=True,user_id='ddf37a47ae5a4aecae1edb0ce3692b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Creating volume afc42717-da19-48ac-9676-adcdc0b23c44 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:19:27 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:19:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:27 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 1073741824 Jun 23 20:19:27 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:27 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-cd568bc4-efcd-4192-8e41-6274edf60810 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Create snapshot completed successfully Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "cinder-1febd933-338e-4d15-8b10-4a1041134412-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-1febd933-338e-4d15-8b10-4a1041134412-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "cinder-quobyte-6f82411c-da4f-436e-bb53-2f33922ecd2c" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-quobyte-6f82411c-da4f-436e-bb53-2f33922ecd2c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "cinder-quobyte-1febd933-338e-4d15-8b10-4a1041134412" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-quobyte-1febd933-338e-4d15-8b10-4a1041134412" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Deleting offline snapshot 1febd933-338e-4d15-8b10-4a1041134412 of volume 6f82411c-da4f-436e-bb53-2f33922ecd2c {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:19:28 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] snapshot_file for this snap is: volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 1073741824" returned: 0 in 0.893s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e50c7f9-486d-4789-9850-d2bdcb3b27d6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:28 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 Jun 23 20:19:28 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:28 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 Jun 23 20:19:28 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:29 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44" returned: 0 in 0.821s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4a26cd-d954-42bc-a299-cc1ac2d01150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc42717-da19-48ac-9676-adcdc0b23c44', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485ed92b-2c19-4137-b913-6fd0a11b31ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:29 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Volume volume-afc42717-da19-48ac-9676-adcdc0b23c44 (afc42717-da19-48ac-9676-adcdc0b23c44): created successfully Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485ed92b-2c19-4137-b913-6fd0a11b31ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Flow 'volume_create_manager' (03f9a07d-b96d-4e45-85e6-e7c2f55a4406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5a9f638e-3940-4c16-87f1-8f78dd97d353 tempest-VolumesListAdminTestJSON-579090129 None] Created volume successfully. Jun 23 20:19:29 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412" returned: 0 in 0.946s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f82411c-da4f-436e-bb53-2f33922ecd2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[49767216-fd11-4330-a59a-478fb2ade495]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:29 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c Jun 23 20:19:29 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:30 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c" returned: 0 in 0.828s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:30 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 Jun 23 20:19:30 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Flow 'volume_create_manager' (fa9702b7-fe8a-470b-a0da-0400b7e066f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea53b0f9-d3b8-449d-a7d2-30a795588eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea53b0f9-d3b8-449d-a7d2-30a795588eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1710030086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f8af99-ec15-4348-8840-410bbf202316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1237c0d9a334690ae1bd6ddf44ae83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:31Z,use_quota=True,user_id='ddf37a47ae5a4aecae1edb0ce3692b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a420daee-1320-42c3-a94f-9c42c2d18f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a420daee-1320-42c3-a94f-9c42c2d18f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a919e715-5efd-4648-9cca-a701f7356329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a919e715-5efd-4648-9cca-a701f7356329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f8af99-ec15-4348-8840-410bbf202316', 'volume_name': 'volume-d4f8af99-ec15-4348-8840-410bbf202316', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2671f940-b5fa-4c61-ac6c-836ccfb4000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2671f940-b5fa-4c61-ac6c-836ccfb4000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb836a5-4c22-42dd-a3ea-5deb0454fc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:30 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Volume d4f8af99-ec15-4348-8840-410bbf202316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f8af99-ec15-4348-8840-410bbf202316', 'volume_size': 1} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1710030086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f8af99-ec15-4348-8840-410bbf202316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1237c0d9a334690ae1bd6ddf44ae83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:31Z,use_quota=True,user_id='ddf37a47ae5a4aecae1edb0ce3692b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Creating volume d4f8af99-ec15-4348-8840-410bbf202316 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:19:30 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:19:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:30 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 1073741824 Jun 23 20:19:30 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:31 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412" returned: 0 in 0.983s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:31 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412 Jun 23 20:19:31 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:32 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 1073741824" returned: 0 in 1.297s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:32 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 Jun 23 20:19:32 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:32 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c.1febd933-338e-4d15-8b10-4a1041134412" returned: 0 in 0.904s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-quobyte-1febd933-338e-4d15-8b10-4a1041134412" released by "_delete_snapshot" :: held 3.803s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-quobyte-6f82411c-da4f-436e-bb53-2f33922ecd2c" released by "delete_snapshot" :: held 3.842s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:32 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Created reservations ['3b8406e0-38d6-42bb-b39e-5124531d3ac3', 'abe646d2-93c1-4752-b2cc-0e8384240555', '4ec982d7-112f-4a8c-9938-54c2f98053de', '35000367-6367-4ab4-a920-40150ecaf016'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Delete snapshot completed successfully. Jun 23 20:19:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa8fe44a-e7e8-40cc-bff3-1df0168d198b tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-1febd933-338e-4d15-8b10-4a1041134412-delete_snapshot" released by "delete_snapshot" :: held 4.024s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "cinder-6f82411c-da4f-436e-bb53-2f33922ecd2c-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-6f82411c-da4f-436e-bb53-2f33922ecd2c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "cinder-quobyte-6f82411c-da4f-436e-bb53-2f33922ecd2c" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-quobyte-6f82411c-da4f-436e-bb53-2f33922ecd2c" acquired by "delete_volume" :: waited 0.048s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fbd09b-bd55-419c-9879-41338c4be945]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:33 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316" returned: 0 in 1.078s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] <== create_volume: return (2435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.438s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb836a5-4c22-42dd-a3ea-5deb0454fc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f8af99-ec15-4348-8840-410bbf202316', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9635a978-809c-4d7a-9309-41ea657bd8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:33 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Volume volume-d4f8af99-ec15-4348-8840-410bbf202316 (d4f8af99-ec15-4348-8840-410bbf202316): created successfully Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9635a978-809c-4d7a-9309-41ea657bd8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Flow 'volume_create_manager' (fa9702b7-fe8a-470b-a0da-0400b7e066f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d5010506-d5e6-4a8f-8838-70159f6802ad tempest-VolumesListAdminTestJSON-579090129 None] Created volume successfully. Jun 23 20:19:33 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c Jun 23 20:19:33 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:34 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c" returned: 0 in 0.955s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:34 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c Jun 23 20:19:34 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Flow 'volume_create_manager' (ca2e8d30-edb3-429d-b274-43b7127a5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c8322e-85b2-432b-9fe8-36b08cd7db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c8322e-85b2-432b-9fe8-36b08cd7db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1144493140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412085bf-174b-467e-85b8-984a4a154ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1237c0d9a334690ae1bd6ddf44ae83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:35Z,use_quota=True,user_id='ddf37a47ae5a4aecae1edb0ce3692b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e28d76-40c0-42dc-bf5d-fe4d255ce678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e28d76-40c0-42dc-bf5d-fe4d255ce678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce5fc63-e316-4f7d-855a-8774bc70e057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce5fc63-e316-4f7d-855a-8774bc70e057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412085bf-174b-467e-85b8-984a4a154ce3', 'volume_name': 'volume-412085bf-174b-467e-85b8-984a4a154ce3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f7f5d2-042e-46aa-992f-44d7d399bf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f7f5d2-042e-46aa-992f-44d7d399bf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4570a4-2ad0-4b29-b6a2-b140c9764235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Volume 412085bf-174b-467e-85b8-984a4a154ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412085bf-174b-467e-85b8-984a4a154ce3', 'volume_size': 1} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1144493140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412085bf-174b-467e-85b8-984a4a154ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1237c0d9a334690ae1bd6ddf44ae83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:35Z,use_quota=True,user_id='ddf37a47ae5a4aecae1edb0ce3692b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Creating volume 412085bf-174b-467e-85b8-984a4a154ce3 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:19:34 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:19:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:34 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 1073741824 Jun 23 20:19:34 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:35 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6f82411c-da4f-436e-bb53-2f33922ecd2c" returned: 0 in 0.927s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-quobyte-6f82411c-da4f-436e-bb53-2f33922ecd2c" released by "delete_volume" :: held 2.008s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Created reservations ['6ca1e7e3-d349-4656-a051-2dcacab513ad', 'ef06e841-bf6a-4ab6-8661-42930a08544f', '2755b5bc-efdc-4d5d-9036-6d7f80346ac3', 'b3e08e79-de8b-432d-8843-674cf8589a30'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:35 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:35 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:35 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 1073741824" returned: 0 in 1.136s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:36 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 Jun 23 20:19:36 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:36 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.837s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Deleted volume successfully. Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb132a-191b-45e0-943f-c27058e38086 tempest-VolumesSnapshotNegativeTestJSON-139007352 None] Lock "cinder-6f82411c-da4f-436e-bb53-2f33922ecd2c-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:36 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3" returned: 0 in 0.807s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4570a4-2ad0-4b29-b6a2-b140c9764235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412085bf-174b-467e-85b8-984a4a154ce3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4045682a-47e1-4f58-aa81-95216cce7216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Volume volume-412085bf-174b-467e-85b8-984a4a154ce3 (412085bf-174b-467e-85b8-984a4a154ce3): created successfully Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4045682a-47e1-4f58-aa81-95216cce7216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Flow 'volume_create_manager' (ca2e8d30-edb3-429d-b274-43b7127a5bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3550f7c0-b71b-4464-b246-993a6fd663d1 tempest-VolumesListAdminTestJSON-579090129 None] Created volume successfully. Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Flow 'volume_create_manager' (1b1e17cd-d1e5-4ece-92ac-9e1b77c5805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d256fb0a-db9a-42a4-8045-d6db3a39bc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d256fb0a-db9a-42a4-8045-d6db3a39bc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4127980d-4494-42f3-a856-8410fd829bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca7716a15a14f6ca809f589889c124a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:39Z,use_quota=True,user_id='fbd4aae0d6034ec885eab5e58a56e98d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5484a8a-caa5-4c6d-9bb3-6f51bc286b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5484a8a-caa5-4c6d-9bb3-6f51bc286b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb0f9ed-e6f3-4a49-8acb-4492bab0713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb0f9ed-e6f3-4a49-8acb-4492bab0713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4127980d-4494-42f3-a856-8410fd829bc4', 'volume_name': 'volume-4127980d-4494-42f3-a856-8410fd829bc4', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2265435b-7c43-41ca-be86-3f7f255ee674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2265435b-7c43-41ca-be86-3f7f255ee674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b478672-8af4-4d23-89f1-c4b5224964a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:39 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Volume 4127980d-4494-42f3-a856-8410fd829bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4127980d-4494-42f3-a856-8410fd829bc4', 'volume_size': 1} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4127980d-4494-42f3-a856-8410fd829bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca7716a15a14f6ca809f589889c124a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:19:39Z,use_quota=True,user_id='fbd4aae0d6034ec885eab5e58a56e98d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Creating volume 4127980d-4494-42f3-a856-8410fd829bc4 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:19:39 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:19:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:39 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 1073741824 Jun 23 20:19:39 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:40 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 1073741824" returned: 0 in 1.337s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:40 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 Jun 23 20:19:40 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:41 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4" returned: 0 in 0.980s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] <== create_volume: return (2388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:19:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b478672-8af4-4d23-89f1-c4b5224964a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4127980d-4494-42f3-a856-8410fd829bc4', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6119130b-7ea5-4386-80cb-3a03fcc774bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:19:41 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Volume volume-4127980d-4494-42f3-a856-8410fd829bc4 (4127980d-4494-42f3-a856-8410fd829bc4): created successfully Jun 23 20:19:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6119130b-7ea5-4386-80cb-3a03fcc774bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:19:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Flow 'volume_create_manager' (1b1e17cd-d1e5-4ece-92ac-9e1b77c5805c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:19:41 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-19499b9a-4085-4f10-ada1-065dbc69433b tempest-VolumesListAdminTestJSON-1927398603 None] Created volume successfully. Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Acquiring lock "cinder-4127980d-4494-42f3-a856-8410fd829bc4-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Lock "cinder-4127980d-4494-42f3-a856-8410fd829bc4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Acquiring lock "cinder-quobyte-4127980d-4494-42f3-a856-8410fd829bc4" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Lock "cinder-quobyte-4127980d-4494-42f3-a856-8410fd829bc4" acquired by "delete_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "cinder-412085bf-174b-467e-85b8-984a4a154ce3-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27de265-ea6b-4d78-803e-cf93497ea3f2]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-412085bf-174b-467e-85b8-984a4a154ce3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Acquiring lock "cinder-6a22c832-5b10-4761-868f-c39a1107149d-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "cinder-quobyte-412085bf-174b-467e-85b8-984a4a154ce3" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "cinder-6a22c832-5b10-4761-868f-c39a1107149d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-quobyte-412085bf-174b-467e-85b8-984a4a154ce3" acquired by "delete_volume" :: waited 0.031s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796a579-4608-45fe-a059-4d079f52fb09]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:42 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:42 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Acquiring lock "cinder-quobyte-6a22c832-5b10-4761-868f-c39a1107149d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "cinder-quobyte-6a22c832-5b10-4761-868f-c39a1107149d" acquired by "delete_volume" :: waited 0.038s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:43 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 Jun 23 20:19:43 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:43 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad3752-20fe-4c1d-8602-9197ace5b504]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:43 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d Jun 23 20:19:43 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:43 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4" returned: 0 in 1.291s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:43 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4 Jun 23 20:19:43 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:44 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3" returned: 0 in 1.138s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:44 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3 Jun 23 20:19:44 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:44 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d" returned: 0 in 1.047s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:44 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d Jun 23 20:19:44 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:45 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4127980d-4494-42f3-a856-8410fd829bc4" returned: 0 in 1.207s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Lock "cinder-quobyte-4127980d-4494-42f3-a856-8410fd829bc4" released by "delete_volume" :: held 2.608s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Created reservations ['46bc5a50-990c-4663-98c0-f856cb298843', '454d8a6c-feb8-4a2e-ba61-6296e27d0b91', '9716c260-4d73-4ebd-9f75-1e143168a26e', 'e87a0cf4-7c74-4a8a-ba83-e17e66635240'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:45 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-412085bf-174b-467e-85b8-984a4a154ce3" returned: 0 in 1.270s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-quobyte-412085bf-174b-467e-85b8-984a4a154ce3" released by "delete_volume" :: held 2.479s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Created reservations ['c7a4eafc-2ed6-4dde-bdd5-beedb285244c', '11dd7584-788a-4020-bf7e-1de116bb71b7', 'e698ce3d-26b4-4312-a59a-5767d1900115', 'e8870819-99e5-4b4a-8683-787f1af6395e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:45 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:45 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:45 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6a22c832-5b10-4761-868f-c39a1107149d" returned: 0 in 1.353s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "cinder-quobyte-6a22c832-5b10-4761-868f-c39a1107149d" released by "delete_volume" :: held 2.486s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:45 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Created reservations ['5beaae47-55f3-47b9-93e2-8c2d363748bc', 'f92ab0bf-5cc6-4cd0-96b4-3472e9e404ed', '6f2e86a9-37ef-4b2d-9964-86f3ebeb7933', '1c2e70c2-177a-46f0-9523-fdb535679a51'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:45 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:45 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:45 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "cinder-d4f8af99-ec15-4348-8840-410bbf202316-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:46 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-d4f8af99-ec15-4348-8840-410bbf202316-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.170s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:46 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Deleted volume successfully. Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4f862ac9-475f-47c6-aba0-6cf8efa81dbf tempest-VolumesListAdminTestJSON-1927398603 None] Lock "cinder-4127980d-4494-42f3-a856-8410fd829bc4-delete_volume" released by "delete_volume" :: held 4.180s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "cinder-quobyte-d4f8af99-ec15-4348-8840-410bbf202316" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:46 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:46 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-quobyte-d4f8af99-ec15-4348-8840-410bbf202316" acquired by "delete_volume" :: waited 0.031s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d589df-3348-450d-9160-06a89476a40c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:46 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.229s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:46 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Deleted volume successfully. Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-54066e80-df25-4488-a556-24eeed2a569b tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-412085bf-174b-467e-85b8-984a4a154ce3-delete_volume" released by "delete_volume" :: held 4.135s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:46 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.166s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:46 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Deleted volume successfully. Jun 23 20:19:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-21afa3e2-cc97-4193-b0d5-2b4fd6026412 tempest-AttachVolumeShelveTestJSON-638918666 None] Lock "cinder-6a22c832-5b10-4761-868f-c39a1107149d-delete_volume" released by "delete_volume" :: held 4.094s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:46 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 Jun 23 20:19:46 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:47 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.935s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:19:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:19:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:19:47 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316" returned: 0 in 1.013s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:47 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316 Jun 23 20:19:47 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:48 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4f8af99-ec15-4348-8840-410bbf202316" returned: 0 in 0.842s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-quobyte-d4f8af99-ec15-4348-8840-410bbf202316" released by "delete_volume" :: held 1.924s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Created reservations ['ac364c19-a279-4864-acca-23fc1aff3383', 'cfa8589b-2aa6-4b19-b953-499b5a5ba58b', '11dc0ddd-aa6e-4a9f-be93-eb8c4078b948', '2935a047-d4d8-4eff-af58-e7887248b12e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:48 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:48 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:50 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.218s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Deleted volume successfully. Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "cinder-afc42717-da19-48ac-9676-adcdc0b23c44-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5483abc7-2735-430a-bee2-4122643bc2f9 tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-d4f8af99-ec15-4348-8840-410bbf202316-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-afc42717-da19-48ac-9676-adcdc0b23c44-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "cinder-quobyte-afc42717-da19-48ac-9676-adcdc0b23c44" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-quobyte-afc42717-da19-48ac-9676-adcdc0b23c44" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afdf277-d6ef-4cd8-89ed-f215a7a4bbab]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:19:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:50 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 Jun 23 20:19:50 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:51 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44" returned: 0 in 1.118s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:51 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44 Jun 23 20:19:51 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:52 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-afc42717-da19-48ac-9676-adcdc0b23c44" returned: 0 in 1.545s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-quobyte-afc42717-da19-48ac-9676-adcdc0b23c44" released by "delete_volume" :: held 2.730s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:19:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Created reservations ['4caf8d1f-89cd-428f-9ac2-878184bf96c3', 'b2944c83-799d-4349-9fb4-9562d9ae3408', '321b3b3b-8f22-4529-a79a-b2379ed57bef', 'ffca5a98-2a8f-4b45-927f-1b382fe10058'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:19:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:19:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:19:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:19:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:19:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:19:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:19:53 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:19:53 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:19:54 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jun 23 20:19:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.511s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:19:54 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:19:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Deleted volume successfully. Jun 23 20:19:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-229f5abb-cf87-44c3-ab0e-362f206048de tempest-VolumesListAdminTestJSON-579090129 None] Lock "cinder-afc42717-da19-48ac-9676-adcdc0b23c44-delete_volume" released by "delete_volume" :: held 4.697s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:03 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=121,cinder:SELECT=84,cinder:INSERT=27,cinder:DELETE=7 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=84,cinder:UPDATE=112,cinder:DELETE=11,cinder:INSERT=32 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Flow 'volume_create_manager' (fb23d23a-2d43-46dd-8f35-49a3218dbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a64ccc-eb85-458c-a351-4211bbbce3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a64ccc-eb85-458c-a351-4211bbbce3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1702299248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc49540-072e-429d-ac85-e1fe36137969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200ce37d37d94c67bad3096d8bd0e388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:04Z,use_quota=True,user_id='3f2a6a581497443e9973d83e85131836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78875c7-3cdc-4faa-87e8-e5fc2ec9174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78875c7-3cdc-4faa-87e8-e5fc2ec9174e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f1bd54-d77c-43f3-aa02-9e13f7f5f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:04 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f1bd54-d77c-43f3-aa02-9e13f7f5f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1dc49540-072e-429d-ac85-e1fe36137969', 'volume_name': 'volume-1dc49540-072e-429d-ac85-e1fe36137969', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f7e866-1e54-4941-a18b-3877d78e53f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f7e866-1e54-4941-a18b-3877d78e53f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bf2c76-4046-4093-a784-2c67a5f12234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:05 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Volume 1dc49540-072e-429d-ac85-e1fe36137969: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1dc49540-072e-429d-ac85-e1fe36137969', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Trying to clone 1dc49540-072e-429d-ac85-e1fe36137969 from image 8123ebb9-f4e0-4d01-974c-3920c780745e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Flow 'volume_create_manager' (ecb1dbec-840a-4cfb-ac51-c64005909c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34dd6e5-bbc9-49f7-a054-b5e2a4a397d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34dd6e5-bbc9-49f7-a054-b5e2a4a397d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-396060177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7aacc3-50b1-448d-8556-fd8b3037928b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a455c9614341e99dbfebb441a8ef69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:05Z,use_quota=True,user_id='22db92bdeae94670b03cfc5437b8ff2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38441b1-4174-4c0c-8c3a-9f121432db66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38441b1-4174-4c0c-8c3a-9f121432db66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1b8b98-3bd2-451a-a6be-56484af153b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1b8b98-3bd2-451a-a6be-56484af153b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7aacc3-50b1-448d-8556-fd8b3037928b', 'volume_name': 'volume-4f7aacc3-50b1-448d-8556-fd8b3037928b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb57cb9-c93e-4fb0-929e-790c2ecf0413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb57cb9-c93e-4fb0-929e-790c2ecf0413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cae0cd-2863-4911-b293-df708978aef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:05 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Volume 4f7aacc3-50b1-448d-8556-fd8b3037928b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7aacc3-50b1-448d-8556-fd8b3037928b', 'volume_size': 1} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-396060177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7aacc3-50b1-448d-8556-fd8b3037928b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a455c9614341e99dbfebb441a8ef69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:05Z,use_quota=True,user_id='22db92bdeae94670b03cfc5437b8ff2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Creating volume 4f7aacc3-50b1-448d-8556-fd8b3037928b {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:05 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:05 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b 1073741824 Jun 23 20:20:05 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:20:05 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Image download 20.69 MB at 20.69 MB/s Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[475a4bcc-f9a8-4df9-b40a-74b8a847d659]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:05 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD Jun 23 20:20:05 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:06 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b 1073741824" returned: 0 in 1.219s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:06 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD" returned: 0 in 0.929s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:06 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Temporary image 8123ebb9-f4e0-4d01-974c-3920c780745e is fetched for user 3f2a6a581497443e9973d83e85131836. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:20:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:06 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b Jun 23 20:20:06 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbb5757-e008-4b8a-9437-45ae4d9cd514]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:06 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD Jun 23 20:20:06 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:07 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b" returned: 0 in 0.872s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cae0cd-2863-4911-b293-df708978aef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7aacc3-50b1-448d-8556-fd8b3037928b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda3c4cd-a540-4762-af3f-8b337c703ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:07 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Volume volume-4f7aacc3-50b1-448d-8556-fd8b3037928b (4f7aacc3-50b1-448d-8556-fd8b3037928b): created successfully Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda3c4cd-a540-4762-af3f-8b337c703ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Flow 'volume_create_manager' (ecb1dbec-840a-4cfb-ac51-c64005909c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:07 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-d6ecaee7-d9c7-41c0-a232-5a36e4ee3880 req-ff2b0d65-2a4c-4f3f-907e-0982f8034e3b tempest-VolumesSnapshotsTestJSON-1045980613 None] Created volume successfully. Jun 23 20:20:07 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD" returned: 0 in 1.113s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1702299248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc49540-072e-429d-ac85-e1fe36137969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200ce37d37d94c67bad3096d8bd0e388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:04Z,use_quota=True,user_id='3f2a6a581497443e9973d83e85131836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Creating volume 1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:07 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:07 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 1073741824 Jun 23 20:20:07 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:08 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 1073741824" returned: 0 in 1.076s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:08 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 Jun 23 20:20:08 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:09 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969" returned: 0 in 0.654s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.825s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Creating offline snapshot 170bf61d-3bd0-48af-82d2-a5c0255a116b of volume 4f7aacc3-50b1-448d-8556-fd8b3037928b {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Attempting download of 8123ebb9-f4e0-4d01-974c-3920c780745e ((None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}])) to volume 1dc49540-072e-429d-ac85-e1fe36137969. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9834d8-369d-44d2-a8ca-3125ec439a93]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[45263853-c486-476b-a429-23c31fb5382e]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_bd2zflnl {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:09 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b Jun 23 20:20:09 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:09 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_bd2zflnl Jun 23 20:20:09 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:10 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_bd2zflnl" returned: 0 in 0.844s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_bd2zflnl {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:10 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b" returned: 0 in 0.967s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:10 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b 1G Jun 23 20:20:10 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:10 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_bd2zflnl Jun 23 20:20:10 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:11 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_bd2zflnl" returned: 1 in 0.917s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_bd2zflnl' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:20:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e67345-e829-407e-b955-56267bc25442]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:11 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD Jun 23 20:20:11 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:11 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b 1G" returned: 0 in 1.135s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7aacc3-50b1-448d-8556-fd8b3037928b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:11 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7aacc3-50b1-448d-8556-fd8b3037928b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b Jun 23 20:20:11 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:12 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD" returned: 0 in 0.911s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:12 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] 8123ebb9-f4e0-4d01-974c-3920c780745e was qcow2, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:20:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:12 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 Jun 23 20:20:12 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:12 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7aacc3-50b1-448d-8556-fd8b3037928b -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b" returned: 0 in 0.866s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:12 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b is being set with open permissions: ugo+rw Jun 23 20:20:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:12 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b Jun 23 20:20:12 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:13 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b" returned: 0 in 0.855s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:13 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.info Jun 23 20:20:13 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:14 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.info" returned: 0 in 0.954s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:14 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.info is being set with open permissions: ugo+rw Jun 23 20:20:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:14 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.info Jun 23 20:20:14 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:15 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969" returned: 0 in 2.587s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_yklok4l9devstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:20:15 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Converted 112.00 MB image at 43.28 MB/s Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:15 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 1G Jun 23 20:20:15 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Flow 'volume_create_manager' (62d4dd6f-6616-40ad-8a9e-17c281292c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951f4759-8cdf-4d14-8ffd-5f7788c483f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951f4759-8cdf-4d14-8ffd-5f7788c483f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1350261277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a21dace-0e80-4de2-be76-8dcf6e4059fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acfc6948c0f4954a2590a77d11967b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:15Z,use_quota=True,user_id='fdcde7e680644a78b028328a450876a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b1620c0-2807-4ee3-9f76-3d0eab02b964),volume_type_id=6b1620c0-2807-4ee3-9f76-3d0eab02b964)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb38402-ecf0-4b2b-9787-b06b02c07d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb38402-ecf0-4b2b-9787-b06b02c07d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b142bf7-c7ce-47f6-9ffc-74f793e891c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b142bf7-c7ce-47f6-9ffc-74f793e891c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a21dace-0e80-4de2-be76-8dcf6e4059fd', 'volume_name': 'volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595d35d9-909b-4510-8b6e-ab13ee8e5c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595d35d9-909b-4510-8b6e-ab13ee8e5c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9933bdc-b0a7-4a4d-bdb7-5523c141bd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume 8a21dace-0e80-4de2-be76-8dcf6e4059fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd', 'volume_size': 1} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Flow 'volume_create_manager' (50cd76ac-f590-4c64-9684-30fa184813e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bfdb0a-6190-4a51-a8f2-cceff04f1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bfdb0a-6190-4a51-a8f2-cceff04f1116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-864653588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4615f2ca-dbf7-4be8-b9e8-f371653be099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c812e38640ce4b2da521ee0a679e1405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:15Z,use_quota=True,user_id='0861987b7efd4b2393a747f8248c3eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0d895d-69a1-4b0f-856b-3699e49b6157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0d895d-69a1-4b0f-856b-3699e49b6157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e092e4c2-52c4-4aee-982e-46550b1657b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e092e4c2-52c4-4aee-982e-46550b1657b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4615f2ca-dbf7-4be8-b9e8-f371653be099', 'volume_name': 'volume-4615f2ca-dbf7-4be8-b9e8-f371653be099', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8beb9d8b-2898-43b3-b5e0-12c40e2eba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8beb9d8b-2898-43b3-b5e0-12c40e2eba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f783e2-13ba-4f9c-8610-117599291e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Volume 4615f2ca-dbf7-4be8-b9e8-f371653be099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4615f2ca-dbf7-4be8-b9e8-f371653be099', 'volume_size': 1} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.info" returned: 0 in 1.049s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.021s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.386s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1350261277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a21dace-0e80-4de2-be76-8dcf6e4059fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acfc6948c0f4954a2590a77d11967b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:15Z,use_quota=True,user_id='fdcde7e680644a78b028328a450876a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b1620c0-2807-4ee3-9f76-3d0eab02b964),volume_type_id=6b1620c0-2807-4ee3-9f76-3d0eab02b964)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Creating volume 8a21dace-0e80-4de2-be76-8dcf6e4059fd {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:15 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:15 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd 1073741824 Jun 23 20:20:15 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-2d171c02-b0fd-417b-9db3-7e5d5f96689c req-326ba65b-9b35-49e9-b816-d1600282fb0c tempest-VolumesSnapshotsTestJSON-1045980613 None] Create snapshot completed successfully Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Flow 'volume_create_manager' (e32774af-35f4-4a26-beb9-e5418d929a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406324cc-cb3d-4b94-8666-60b14d22e1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406324cc-cb3d-4b94-8666-60b14d22e1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2104656047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c4e175-b006-433e-9888-fef05c0a1fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acfc6948c0f4954a2590a77d11967b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:16Z,use_quota=True,user_id='fdcde7e680644a78b028328a450876a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c14df84-3566-4db4-b166-9e00b5faad6e),volume_type_id=9c14df84-3566-4db4-b166-9e00b5faad6e)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb04e15a-3498-4eed-92d2-6aadd2e0ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb04e15a-3498-4eed-92d2-6aadd2e0ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8825f5d3-e5a7-4396-aca9-1e917ea9ad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8825f5d3-e5a7-4396-aca9-1e917ea9ad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c4e175-b006-433e-9888-fef05c0a1fbb', 'volume_name': 'volume-c7c4e175-b006-433e-9888-fef05c0a1fbb', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0bbbcf-b800-432d-b4b8-ec970032f767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0bbbcf-b800-432d-b4b8-ec970032f767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b08062-0980-48a7-882a-647fc6e32be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume c7c4e175-b006-433e-9888-fef05c0a1fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c4e175-b006-433e-9888-fef05c0a1fbb', 'volume_size': 1} Jun 23 20:20:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:16 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 1G" returned: 0 in 1.158s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Flow 'volume_create_manager' (f84de786-c7cf-4b60-bfd9-888961cf16ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ec679c-9854-47e9-8ec8-fd0f9ccf2d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[640c386a-be4e-44f8-948d-32f1f6c4eea5]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ec679c-9854-47e9-8ec8-fd0f9ccf2d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-730967356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a69d4f-1690-439f-8b53-510bcd315f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acfc6948c0f4954a2590a77d11967b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:16Z,use_quota=True,user_id='fdcde7e680644a78b028328a450876a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ebfeda4-ee12-4eb6-9720-9a0a97233df5),volume_type_id=2ebfeda4-ee12-4eb6-9720-9a0a97233df5)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c356dd-1fa0-4c41-91dd-4476ee7e6ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c356dd-1fa0-4c41-91dd-4476ee7e6ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab796900-af1c-4170-a63f-b48489cb1080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:20:16 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 Jun 23 20:20:16 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab796900-af1c-4170-a63f-b48489cb1080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84a69d4f-1690-439f-8b53-510bcd315f46', 'volume_name': 'volume-84a69d4f-1690-439f-8b53-510bcd315f46', 'volume_size': 1, 'image_id': '7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--247270119', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3acfc6948c0f4954a2590a77d11967b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'created_at': datetime.datetime(2026, 6, 23, 18, 20, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db/file', 'properties': {}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0b4850-dbd8-4fb5-b6e4-4d33fe6749f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0b4850-dbd8-4fb5-b6e4-4d33fe6749f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8f748f-6301-49b6-9b4a-a0aa594bfcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:16 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume 84a69d4f-1690-439f-8b53-510bcd315f46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84a69d4f-1690-439f-8b53-510bcd315f46', 'volume_size': 1, 'image_id': '7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--247270119', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3acfc6948c0f4954a2590a77d11967b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'created_at': datetime.datetime(2026, 6, 23, 18, 20, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db/file', 'properties': {}}, 'image_service': } Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Trying to clone 84a69d4f-1690-439f-8b53-510bcd315f46 from image 7e544111-8f68-41bc-b7e1-d40caaa6a4db at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "cinder-170bf61d-3bd0-48af-82d2-a5c0255a116b-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-170bf61d-3bd0-48af-82d2-a5c0255a116b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "cinder-quobyte-4f7aacc3-50b1-448d-8556-fd8b3037928b" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-quobyte-4f7aacc3-50b1-448d-8556-fd8b3037928b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "cinder-quobyte-170bf61d-3bd0-48af-82d2-a5c0255a116b" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-quobyte-170bf61d-3bd0-48af-82d2-a5c0255a116b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Deleting offline snapshot 170bf61d-3bd0-48af-82d2-a5c0255a116b of volume 4f7aacc3-50b1-448d-8556-fd8b3037928b {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] snapshot_file for this snap is: volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb65fdc-a87b-492d-b6ba-f6e1db1d6e2f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:16 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd 1073741824" returned: 0 in 1.285s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:16 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd Jun 23 20:20:16 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:16 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b Jun 23 20:20:16 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:17 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969" returned: 0 in 0.973s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:17 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 Jun 23 20:20:17 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:17 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd" returned: 0 in 0.715s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-864653588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4615f2ca-dbf7-4be8-b9e8-f371653be099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c812e38640ce4b2da521ee0a679e1405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:15Z,use_quota=True,user_id='0861987b7efd4b2393a747f8248c3eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Creating volume 4615f2ca-dbf7-4be8-b9e8-f371653be099 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:17 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:17 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 1073741824 Jun 23 20:20:17 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9933bdc-b0a7-4a4d-bdb7-5523c141bd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4355238d-f5cc-4ed5-a974-673801fa682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:17 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd (8a21dace-0e80-4de2-be76-8dcf6e4059fd): created successfully Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4355238d-f5cc-4ed5-a974-673801fa682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Flow 'volume_create_manager' (62d4dd6f-6616-40ad-8a9e-17c281292c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:17 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bd71d75f-2e14-4c9a-86d5-3b6b723e1531 tempest-TestInstancesWithCinderVolumes-2039171554 None] Created volume successfully. Jun 23 20:20:17 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b" returned: 0 in 1.081s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f7aacc3-50b1-448d-8556-fd8b3037928b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d0b575-f8f9-48ce-9f03-0bf671f51fda]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:18 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b Jun 23 20:20:18 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:18 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969" returned: 1 in 1.019s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Downloaded image 8123ebb9-f4e0-4d01-974c-3920c780745e ((None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}])) to volume 1dc49540-072e-429d-ac85-e1fe36137969 successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Temporary image 8123ebb9-f4e0-4d01-974c-3920c780745e for user 3f2a6a581497443e9973d83e85131836 is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Marking volume 1dc49540-072e-429d-ac85-e1fe36137969 as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Copying metadata from image 8123ebb9-f4e0-4d01-974c-3920c780745e to 1dc49540-072e-429d-ac85-e1fe36137969. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Creating volume glance metadata for volume 1dc49540-072e-429d-ac85-e1fe36137969 backed by image 8123ebb9-f4e0-4d01-974c-3920c780745e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bf2c76-4046-4093-a784-2c67a5f12234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc49540-072e-429d-ac85-e1fe36137969', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e34e7d-825f-4d0f-ba6c-0fd14dba2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:18 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Volume volume-1dc49540-072e-429d-ac85-e1fe36137969 (1dc49540-072e-429d-ac85-e1fe36137969): created successfully Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e34e7d-825f-4d0f-ba6c-0fd14dba2aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Flow 'volume_create_manager' (fb23d23a-2d43-46dd-8f35-49a3218dbd98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-340d2377-5afb-4b8b-895d-0460059eeb0b tempest-VolumesImageMetadata-2049397836 None] Created volume successfully. Jun 23 20:20:18 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 1073741824" returned: 0 in 1.101s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:18 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 Jun 23 20:20:18 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:18 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b" returned: 0 in 0.973s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:18 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b Jun 23 20:20:18 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Acquiring lock "cinder-1dc49540-072e-429d-ac85-e1fe36137969-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Lock "cinder-1dc49540-072e-429d-ac85-e1fe36137969-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Acquiring lock "cinder-quobyte-1dc49540-072e-429d-ac85-e1fe36137969" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Lock "cinder-quobyte-1dc49540-072e-429d-ac85-e1fe36137969" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8215521-bceb-4611-8cf4-c5f10d8ddb02]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:19 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 Jun 23 20:20:19 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:19 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099" returned: 0 in 0.755s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.804s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2104656047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c4e175-b006-433e-9888-fef05c0a1fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acfc6948c0f4954a2590a77d11967b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:16Z,use_quota=True,user_id='fdcde7e680644a78b028328a450876a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c14df84-3566-4db4-b166-9e00b5faad6e),volume_type_id=9c14df84-3566-4db4-b166-9e00b5faad6e)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Creating volume c7c4e175-b006-433e-9888-fef05c0a1fbb {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:19 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f783e2-13ba-4f9c-8610-117599291e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4615f2ca-dbf7-4be8-b9e8-f371653be099', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e7b8a9-3679-4164-9868-d79568d1d8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:19 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb 1073741824 Jun 23 20:20:19 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:19 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Volume volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 (4615f2ca-dbf7-4be8-b9e8-f371653be099): created successfully Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e7b8a9-3679-4164-9868-d79568d1d8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Flow 'volume_create_manager' (50cd76ac-f590-4c64-9684-30fa184813e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:19 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f1ee09f6-b273-4a8d-b03c-3aa0eedfdfab tempest-AttachVolumeTestJSON-462274605 None] Created volume successfully. Jun 23 20:20:19 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b" returned: 0 in 0.992s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:19 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b Jun 23 20:20:19 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:20 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969" returned: 0 in 0.871s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:20 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 Jun 23 20:20:20 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:20 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb 1073741824" returned: 0 in 1.228s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:20 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b.170bf61d-3bd0-48af-82d2-a5c0255a116b" returned: 0 in 1.071s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:20 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb Jun 23 20:20:20 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-quobyte-170bf61d-3bd0-48af-82d2-a5c0255a116b" released by "_delete_snapshot" :: held 4.281s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-quobyte-4f7aacc3-50b1-448d-8556-fd8b3037928b" released by "delete_snapshot" :: held 4.323s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.quota [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Created reservations ['eff5f037-8a38-4b5d-8438-9f875ac228f4', 'aa25ff8b-fcec-4503-a2a6-8effc7998fd1', 'ee46a4e5-d52c-41b8-a458-c77f79992b25', '765c1d31-20fa-47e9-aefb-97bab73bdc5b'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD, size 20.69 MB, duration 4.50 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:20:21 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Image download 20.69 MB at 4.60 MB/s Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eabb4a6-5447-4a92-999f-80d49dee871c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Delete snapshot completed successfully. Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-cb63f8c7-3744-416a-b50d-a3a607a596c4 req-4e22e191-5a03-4283-8f55-92cf43f79fe9 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-170bf61d-3bd0-48af-82d2-a5c0255a116b-delete_snapshot" released by "delete_snapshot" :: held 4.553s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:21 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:21 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD Jun 23 20:20:21 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969" returned: 1 in 1.188s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:21 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969 Jun 23 20:20:21 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:21 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb" returned: 0 in 0.795s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b08062-0980-48a7-882a-647fc6e32be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c4e175-b006-433e-9888-fef05c0a1fbb', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5e2006-5baa-490e-98fe-03b034f63b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:21 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume volume-c7c4e175-b006-433e-9888-fef05c0a1fbb (c7c4e175-b006-433e-9888-fef05c0a1fbb): created successfully Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5e2006-5baa-490e-98fe-03b034f63b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Flow 'volume_create_manager' (e32774af-35f4-4a26-beb9-e5418d929a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a33047f2-4083-4290-87ea-95f71dee4525 tempest-TestInstancesWithCinderVolumes-2039171554 None] Created volume successfully. Jun 23 20:20:22 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1dc49540-072e-429d-ac85-e1fe36137969" returned: 0 in 0.674s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:22 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD" returned: 0 in 0.820s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Temporary image 7e544111-8f68-41bc-b7e1-d40caaa6a4db is fetched for user fdcde7e680644a78b028328a450876a2. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Lock "cinder-quobyte-1dc49540-072e-429d-ac85-e1fe36137969" released by "delete_volume" :: held 2.826s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Created reservations ['88beeb94-80bd-4e46-8c4f-bca1a8edb900', 'ae5f18bd-fada-4776-ade5-9b609af925c1', '19555809-3763-437f-b9cf-75bdf5bb2306', '6ee1cc7d-54a0-4056-a2ac-e8a93283a343'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[39798f06-4673-4483-8308-c6e899973f91]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:22 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:20:22 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:22 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD Jun 23 20:20:22 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "cinder-4f7aacc3-50b1-448d-8556-fd8b3037928b-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-4f7aacc3-50b1-448d-8556-fd8b3037928b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "cinder-quobyte-4f7aacc3-50b1-448d-8556-fd8b3037928b" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-quobyte-4f7aacc3-50b1-448d-8556-fd8b3037928b" acquired by "delete_volume" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd13fd0-05ef-465b-b31f-61dbfd934936]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:22 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b Jun 23 20:20:22 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:23 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.939s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:20:23 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD" returned: 0 in 1.042s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-730967356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a69d4f-1690-439f-8b53-510bcd315f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acfc6948c0f4954a2590a77d11967b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:16Z,use_quota=True,user_id='fdcde7e680644a78b028328a450876a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ebfeda4-ee12-4eb6-9720-9a0a97233df5),volume_type_id=2ebfeda4-ee12-4eb6-9720-9a0a97233df5)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Creating volume 84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:23 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:23 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Deleted volume successfully. Jun 23 20:20:23 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 1073741824 Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2f61f25c-3141-4a60-93a7-358881d17e18 tempest-VolumesImageMetadata-2049397836 None] Lock "cinder-1dc49540-072e-429d-ac85-e1fe36137969-delete_volume" released by "delete_volume" :: held 4.098s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:23 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:23 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b" returned: 0 in 1.127s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:23 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b Jun 23 20:20:23 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-3aa49bed-aa2a-468d-a9fa-b04723338103 req-842d09db-f793-4b6e-b841-19ac5009e1ed tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:24 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 1073741824" returned: 0 in 1.056s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:24 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:20:24 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:24 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4f7aacc3-50b1-448d-8556-fd8b3037928b" returned: 0 in 0.802s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-quobyte-4f7aacc3-50b1-448d-8556-fd8b3037928b" released by "delete_volume" :: held 1.996s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG cinder.quota [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Created reservations ['6b9a2afe-9e4c-426d-ae47-e5831157438d', 'ae660030-935c-4376-a923-f2d0d2da2eba', '4021e811-a74b-4fa3-9ccb-7797ee634c57', '36631251-aee8-408d-8662-80b44f409fff'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:24 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:20:24 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:25 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 0 in 0.794s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-3aa49bed-aa2a-468d-a9fa-b04723338103 req-842d09db-f793-4b6e-b841-19ac5009e1ed tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.203s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b0c120-f2c2-4d1f-8682-6976a4a02c7a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-3aa49bed-aa2a-468d-a9fa-b04723338103 req-842d09db-f793-4b6e-b841-19ac5009e1ed tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Attempting download of 7e544111-8f68-41bc-b7e1-d40caaa6a4db ((None, [{'url': 'file:///opt/stack/data/glance/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'metadata': {}}])) to volume 84a69d4f-1690-439f-8b53-510bcd315f46. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b4268b-6cf9-405a-94f0-db3ff1299858]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e544111-8f68-41bc-b7e1-d40caaa6a4db__53mjev0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:25 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 Jun 23 20:20:25 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:25 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.903s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:25 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e544111-8f68-41bc-b7e1-d40caaa6a4db__53mjev0 Jun 23 20:20:25 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG cinder.manager [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:20:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Deleted volume successfully. Jun 23 20:20:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-e96ad648-ffb1-404d-8371-8aa72a5a05f1 req-48221b62-89b5-4dd4-8915-59d6e2a4fa94 tempest-VolumesSnapshotsTestJSON-1045980613 None] Lock "cinder-4f7aacc3-50b1-448d-8556-fd8b3037928b-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:26 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-3aa49bed-aa2a-468d-a9fa-b04723338103 req-842d09db-f793-4b6e-b841-19ac5009e1ed tempest-AttachVolumeTestJSON-462274605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099" returned: 0 in 1.184s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-3aa49bed-aa2a-468d-a9fa-b04723338103 req-842d09db-f793-4b6e-b841-19ac5009e1ed tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.228s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:26 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e544111-8f68-41bc-b7e1-d40caaa6a4db__53mjev0" returned: 0 in 1.082s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e544111-8f68-41bc-b7e1-d40caaa6a4db__53mjev0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (cbdce14d-ffc8-4cc0-90b8-6d7d17e4281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a819b-709f-47c5-adf3-7814a5279b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a819b-709f-47c5-adf3-7814a5279b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1270478038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c03267-ab00-4687-99e6-972f04a2cdce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:26Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15078566-f9a8-470a-a047-6011769fe011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15078566-f9a8-470a-a047-6011769fe011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4bfd11-31b0-450e-a1e2-776887046eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4bfd11-31b0-450e-a1e2-776887046eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c03267-ab00-4687-99e6-972f04a2cdce', 'volume_name': 'volume-36c03267-ab00-4687-99e6-972f04a2cdce', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2341e70c-a845-4dcd-9a0f-d974b71f51ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2341e70c-a845-4dcd-9a0f-d974b71f51ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:26 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e544111-8f68-41bc-b7e1-d40caaa6a4db__53mjev0 Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dde5d71-ca19-4873-bc94-fe82300e0814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:26 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Volume 36c03267-ab00-4687-99e6-972f04a2cdce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c03267-ab00-4687-99e6-972f04a2cdce', 'volume_size': 1} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:26 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1270478038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c03267-ab00-4687-99e6-972f04a2cdce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:26Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Creating volume 36c03267-ab00-4687-99e6-972f04a2cdce {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:26 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-3aa49bed-aa2a-468d-a9fa-b04723338103 req-842d09db-f793-4b6e-b841-19ac5009e1ed tempest-AttachVolumeTestJSON-462274605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-4615f2ca-dbf7-4be8-b9e8-f371653be099', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88b658e2-f84d-43f5-ba30-279285d659ab', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:20:26 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce 1073741824 Jun 23 20:20:26 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:26 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-3aa49bed-aa2a-468d-a9fa-b04723338103 req-842d09db-f793-4b6e-b841-19ac5009e1ed tempest-AttachVolumeTestJSON-462274605 None] attachment_update completed successfully. Jun 23 20:20:27 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e544111-8f68-41bc-b7e1-d40caaa6a4db__53mjev0" returned: 1 in 0.916s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e544111-8f68-41bc-b7e1-d40caaa6a4db__53mjev0' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:20:27 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb7fd1-855e-4c37-b38a-cdc1b4cc668d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:27 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD Jun 23 20:20:27 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:27 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce 1073741824" returned: 0 in 1.098s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:27 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce Jun 23 20:20:27 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:28 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD" returned: 0 in 0.824s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] 7e544111-8f68-41bc-b7e1-d40caaa6a4db was qcow2, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:28 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:20:28 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:28 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce" returned: 0 in 0.805s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dde5d71-ca19-4873-bc94-fe82300e0814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c03267-ab00-4687-99e6-972f04a2cdce', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20085d0c-e175-47f1-b5d6-c9a7f24176a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:28 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Volume volume-36c03267-ab00-4687-99e6-972f04a2cdce (36c03267-ab00-4687-99e6-972f04a2cdce): created successfully Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20085d0c-e175-47f1-b5d6-c9a7f24176a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (cbdce14d-ffc8-4cc0-90b8-6d7d17e4281c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:28 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-325faff0-d952-4398-bdb1-866086875d67 tempest-VolumesGetTest-989358559 None] Created volume successfully. Jun 23 20:20:30 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 0 in 2.391s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e544111-8f68-41bc-b7e1-d40caaa6a4db_1zs2wnu6devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:20:30 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Converted 112.00 MB image at 46.82 MB/s Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:30 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 1G Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:30 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (2cd7d44b-1730-4ff7-94b1-3b70ac7d44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a0cb23-13a9-4281-bc29-e021fbb2d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a0cb23-13a9-4281-bc29-e021fbb2d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-61026266',display_name='tempest-VolumesGetTest-Volume-2137248779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b381984d-ee1a-4921-af7c-d95cd8ea4493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:30Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbdbd4e-96f1-49f0-b169-1e92ed407f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbdbd4e-96f1-49f0-b169-1e92ed407f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0a4ce6-d9fe-4ee5-b41c-7cb1da461e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0a4ce6-d9fe-4ee5-b41c-7cb1da461e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b381984d-ee1a-4921-af7c-d95cd8ea4493', 'volume_name': 'volume-b381984d-ee1a-4921-af7c-d95cd8ea4493', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac80eff-5ea7-4b14-b19d-b37a42971384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac80eff-5ea7-4b14-b19d-b37a42971384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43945b22-5bb0-47c4-843a-39627902cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:30 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Volume b381984d-ee1a-4921-af7c-d95cd8ea4493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b381984d-ee1a-4921-af7c-d95cd8ea4493', 'volume_size': 1} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-61026266',display_name='tempest-VolumesGetTest-Volume-2137248779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b381984d-ee1a-4921-af7c-d95cd8ea4493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:30Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Creating volume b381984d-ee1a-4921-af7c-d95cd8ea4493 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:30 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:30 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 1073741824 Jun 23 20:20:30 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:31 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 1G" returned: 0 in 0.851s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7088d812-e740-4409-a587-e2b3c576b22b]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:31 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:20:31 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:31 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 1073741824" returned: 0 in 1.063s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:31 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 Jun 23 20:20:31 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:32 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 0 in 0.965s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:32 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:20:32 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:32 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493" returned: 0 in 0.880s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43945b22-5bb0-47c4-843a-39627902cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b381984d-ee1a-4921-af7c-d95cd8ea4493', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b89430-472c-400d-8527-cfbc5d4b69c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Flow 'volume_create_manager' (104b425d-c84d-497a-9280-28417a9e644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4524039d-cca6-40b2-84f4-7be8322a8de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:32 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Volume volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 (b381984d-ee1a-4921-af7c-d95cd8ea4493): created successfully Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b89430-472c-400d-8527-cfbc5d4b69c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (2cd7d44b-1730-4ff7-94b1-3b70ac7d44ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4524039d-cca6-40b2-84f4-7be8322a8de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-611408823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0944eae1-4cab-43bc-ba39-4f0c7aeee2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c812e38640ce4b2da521ee0a679e1405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:33Z,use_quota=True,user_id='0861987b7efd4b2393a747f8248c3eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fcfd00-b78e-4bb5-8295-8f721f4e9582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fcfd00-b78e-4bb5-8295-8f721f4e9582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9bb1c6-8fa6-42cb-8d2d-6ea8a72cd426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9bb1c6-8fa6-42cb-8d2d-6ea8a72cd426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0944eae1-4cab-43bc-ba39-4f0c7aeee2a2', 'volume_name': 'volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e3e0d4-0657-40e1-a83b-939fda00d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e3e0d4-0657-40e1-a83b-939fda00d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fb8786-b0f1-4b14-a755-49c891358b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:32 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Volume 0944eae1-4cab-43bc-ba39-4f0c7aeee2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2', 'volume_size': 1} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-611408823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0944eae1-4cab-43bc-ba39-4f0c7aeee2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c812e38640ce4b2da521ee0a679e1405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:33Z,use_quota=True,user_id='0861987b7efd4b2393a747f8248c3eaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Creating volume 0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:32 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-410bfef3-ba6c-4df5-b716-9bbfd9847d06 tempest-VolumesGetTest-989358559 None] Created volume successfully. Jun 23 20:20:32 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 1073741824 Jun 23 20:20:32 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:33 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 1 in 0.915s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Downloaded image 7e544111-8f68-41bc-b7e1-d40caaa6a4db ((None, [{'url': 'file:///opt/stack/data/glance/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'metadata': {}}])) to volume 84a69d4f-1690-439f-8b53-510bcd315f46 successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Temporary image 7e544111-8f68-41bc-b7e1-d40caaa6a4db for user fdcde7e680644a78b028328a450876a2 is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Marking volume 84a69d4f-1690-439f-8b53-510bcd315f46 as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Copying metadata from image 7e544111-8f68-41bc-b7e1-d40caaa6a4db to 84a69d4f-1690-439f-8b53-510bcd315f46. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Creating volume glance metadata for volume 84a69d4f-1690-439f-8b53-510bcd315f46 backed by image 7e544111-8f68-41bc-b7e1-d40caaa6a4db with: {'image_id': '7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'image_name': 'tempest-scenario-img--247270119', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8f748f-6301-49b6-9b4a-a0aa594bfcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a69d4f-1690-439f-8b53-510bcd315f46', 'volume_size': 1, 'image_id': '7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--247270119', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3acfc6948c0f4954a2590a77d11967b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e544111-8f68-41bc-b7e1-d40caaa6a4db', 'created_at': datetime.datetime(2026, 6, 23, 18, 20, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e544111-8f68-41bc-b7e1-d40caaa6a4db/file', 'properties': {}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a437ae-b2ff-4bfe-aa3f-57afde01d0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:33 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Volume volume-84a69d4f-1690-439f-8b53-510bcd315f46 (84a69d4f-1690-439f-8b53-510bcd315f46): created successfully Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a437ae-b2ff-4bfe-aa3f-57afde01d0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Flow 'volume_create_manager' (f84de786-c7cf-4b60-bfd9-888961cf16ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fadfa983-17a5-4e87-b2fa-2e0d6fa849fd tempest-TestInstancesWithCinderVolumes-2039171554 None] Created volume successfully. Jun 23 20:20:33 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 1073741824" returned: 0 in 0.998s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:33 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-b381984d-ee1a-4921-af7c-d95cd8ea4493-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:33 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Lock "cinder-b381984d-ee1a-4921-af7c-d95cd8ea4493-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-b381984d-ee1a-4921-af7c-d95cd8ea4493" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-b381984d-ee1a-4921-af7c-d95cd8ea4493" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ec83fb-aa76-4c81-9b35-dee20d23efbf]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:34 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 Jun 23 20:20:34 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Flow 'volume_create_manager' (09052645-88c8-4790-87c3-b91be0fd2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545af77b-dd25-4c32-877f-94c02aed8859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545af77b-dd25-4c32-877f-94c02aed8859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-513205938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d118fd08-d2d7-4787-b597-cfe3ae2d37ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b273728e214eeaa879637d7601b39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:34Z,use_quota=True,user_id='8492a3cb6afe49449c6b51a0eae4a14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9dae98c-6bc2-4cf5-9710-5e86c628848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9dae98c-6bc2-4cf5-9710-5e86c628848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3c6320-7baf-4f09-a7f4-a71cdcccde5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3c6320-7baf-4f09-a7f4-a71cdcccde5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd118fd08-d2d7-4787-b597-cfe3ae2d37ae', 'volume_name': 'volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cab6d39-49b3-4b38-8b53-4b1c1c79b737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cab6d39-49b3-4b38-8b53-4b1c1c79b737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e349d623-5bcb-4e04-a4a0-2d9b51a78523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae', 'volume_size': 1} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:34 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2" returned: 0 in 0.828s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-513205938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d118fd08-d2d7-4787-b597-cfe3ae2d37ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b273728e214eeaa879637d7601b39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:34Z,use_quota=True,user_id='8492a3cb6afe49449c6b51a0eae4a14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Creating volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:34 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:34 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae 1073741824 Jun 23 20:20:34 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fb8786-b0f1-4b14-a755-49c891358b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac4ac97-06b5-485a-a39b-c3f128115b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Volume volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 (0944eae1-4cab-43bc-ba39-4f0c7aeee2a2): created successfully Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac4ac97-06b5-485a-a39b-c3f128115b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Flow 'volume_create_manager' (104b425d-c84d-497a-9280-28417a9e644a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9eefbd7b-c463-4696-86cc-f0f0dc6e8602 tempest-AttachVolumeTestJSON-462274605 None] Created volume successfully. Jun 23 20:20:34 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493" returned: 0 in 0.897s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:34 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493 Jun 23 20:20:34 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:35 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b381984d-ee1a-4921-af7c-d95cd8ea4493" returned: 0 in 0.718s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-b381984d-ee1a-4921-af7c-d95cd8ea4493" released by "delete_volume" :: held 1.671s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Created reservations ['2669484f-feb3-4cd0-93e3-a4b6b84ebcf1', '9e3da73f-594b-4633-a4ba-6eec71f4148e', 'b7cc5aa9-9fd3-4444-8389-64f4c8c13762', '0276c2a1-ad22-4c15-9cc0-fbe64b7d8cf3'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:35 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:20:35 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:35 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae 1073741824" returned: 0 in 1.215s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:36 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae Jun 23 20:20:36 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-36c03267-ab00-4687-99e6-972f04a2cdce-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Lock "cinder-36c03267-ab00-4687-99e6-972f04a2cdce-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-36c03267-ab00-4687-99e6-972f04a2cdce" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-36c03267-ab00-4687-99e6-972f04a2cdce" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f5137e-790f-4d01-8dbd-b3e5007f538a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:36 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce Jun 23 20:20:36 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:36 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.801s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:20:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Deleted volume successfully. Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3ffa67e2-62f5-4279-ae32-83f4017ef951 tempest-VolumesGetTest-989358559 None] Lock "cinder-b381984d-ee1a-4921-af7c-d95cd8ea4493-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:36 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" returned: 0 in 0.768s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e349d623-5bcb-4e04-a4a0-2d9b51a78523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4070155-1d52-49f9-9cc5-8b7aa5d810a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Volume volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae (d118fd08-d2d7-4787-b597-cfe3ae2d37ae): created successfully Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4070155-1d52-49f9-9cc5-8b7aa5d810a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Flow 'volume_create_manager' (09052645-88c8-4790-87c3-b91be0fd2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d79992c0-6921-4d5c-8eb7-d4dbcce58fd5 tempest-SnapshotsActionsTest-1693159980 None] Created volume successfully. Jun 23 20:20:37 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce" returned: 0 in 0.853s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:37 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce Jun 23 20:20:37 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Creating offline snapshot d02752eb-721d-4b58-88bf-d67e385f45b1 of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05e867-7279-4845-a496-1ced69da8d9a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:37 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae Jun 23 20:20:37 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:37 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c03267-ab00-4687-99e6-972f04a2cdce" returned: 0 in 0.704s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-36c03267-ab00-4687-99e6-972f04a2cdce" released by "delete_volume" :: held 1.611s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Created reservations ['70c12a3f-3758-4761-ae09-5592cf6e1ffa', 'e5e0c324-b279-4ad7-9e0e-e21d5294bc55', '06aa5389-505e-4e46-9d7e-8a7bf89ea397', '1cf241eb-638e-4f38-bfad-a28392f43556'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:38 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:20:38 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:38 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" returned: 0 in 0.887s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:38 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 1G Jun 23 20:20:38 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:38 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.854s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:38 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:20:39 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Deleted volume successfully. Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b906a2d8-4399-462b-9f00-0ab87985495b tempest-VolumesGetTest-989358559 None] Lock "cinder-36c03267-ab00-4687-99e6-972f04a2cdce-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (5bd3357b-eebd-4007-a481-bf687e183323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977ea678-11e0-46b3-803d-e97d033fc009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-a822ad34-0da7-4685-8c6a-d8d4ce8fb1a5 req-5c81c6db-8dd7-4a63-9409-61b856ec024a tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977ea678-11e0-46b3-803d-e97d033fc009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-361582440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d47f06-4ce3-4367-b330-b975dd341364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:39Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bb2c98-0cbd-43de-b554-340832fdf490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bb2c98-0cbd-43de-b554-340832fdf490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26d1581-527a-4e67-826b-bbf039e55b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26d1581-527a-4e67-826b-bbf039e55b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d47f06-4ce3-4367-b330-b975dd341364', 'volume_name': 'volume-32d47f06-4ce3-4367-b330-b975dd341364', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bc538c-5c16-4338-953c-2fd874973e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bc538c-5c16-4338-953c-2fd874973e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a503b3-4ad5-4f6a-bd54-01391c37f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:39 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Volume 32d47f06-4ce3-4367-b330-b975dd341364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d47f06-4ce3-4367-b330-b975dd341364', 'volume_size': 1} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:39 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 1G" returned: 0 in 0.978s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:39 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:20:39 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:40 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 0.777s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:40 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 is being set with open permissions: ugo+rw Jun 23 20:20:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:40 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:20:40 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:41 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 0.795s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:41 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.info Jun 23 20:20:41 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:41 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.info" returned: 0 in 0.755s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:41 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.info is being set with open permissions: ugo+rw Jun 23 20:20:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:42 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.info Jun 23 20:20:42 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:42 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.info" returned: 0 in 0.693s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-a822ad34-0da7-4685-8c6a-d8d4ce8fb1a5 req-5c81c6db-8dd7-4a63-9409-61b856ec024a tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.447s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:42 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19dc829-5e08-4b52-a438-0b5fa8628b68]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-a822ad34-0da7-4685-8c6a-d8d4ce8fb1a5 req-5c81c6db-8dd7-4a63-9409-61b856ec024a tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-17dbd259-5dcf-4d70-aac2-0a8d3615678f tempest-SnapshotsActionsTest-1693159980 None] Create snapshot completed successfully Jun 23 20:20:42 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 Jun 23 20:20:42 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:43 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-a822ad34-0da7-4685-8c6a-d8d4ce8fb1a5 req-5c81c6db-8dd7-4a63-9409-61b856ec024a tempest-AttachVolumeTestJSON-462274605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2" returned: 0 in 0.770s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-a822ad34-0da7-4685-8c6a-d8d4ce8fb1a5 req-5c81c6db-8dd7-4a63-9409-61b856ec024a tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.205s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-361582440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d47f06-4ce3-4367-b330-b975dd341364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:39Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Creating volume 32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:20:43 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:43 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 1073741824 Jun 23 20:20:43 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-a822ad34-0da7-4685-8c6a-d8d4ce8fb1a5 req-5c81c6db-8dd7-4a63-9409-61b856ec024a tempest-AttachVolumeTestJSON-462274605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f738e313-a1c4-48a2-a306-86d82690dac6', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:20:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-a822ad34-0da7-4685-8c6a-d8d4ce8fb1a5 req-5c81c6db-8dd7-4a63-9409-61b856ec024a tempest-AttachVolumeTestJSON-462274605 None] attachment_update completed successfully. Jun 23 20:20:44 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 1073741824" returned: 0 in 1.006s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:44 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 Jun 23 20:20:44 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:45 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364" returned: 0 in 0.780s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.693s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a503b3-4ad5-4f6a-bd54-01391c37f762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d47f06-4ce3-4367-b330-b975dd341364', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cb9e27-93c9-4b1a-b5e5-78c79b2321b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:45 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Volume volume-32d47f06-4ce3-4367-b330-b975dd341364 (32d47f06-4ce3-4367-b330-b975dd341364): created successfully Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cb9e27-93c9-4b1a-b5e5-78c79b2321b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (5bd3357b-eebd-4007-a481-bf687e183323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[827fa8e4-32b9-4bbc-92ff-56303c4a632a]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:45 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8714bf58-ed8b-4315-a770-1e65b9806004 tempest-VolumesGetTest-989358559 None] Created volume successfully. Jun 23 20:20:45 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:20:45 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:46 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 0 in 0.751s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:46 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:20:46 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:46 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:20:46 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (145b04f8-1114-44cc-a56a-ac54ef8aa758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe3e9a6-5b33-419e-aded-3a1124b9d429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe3e9a6-5b33-419e-aded-3a1124b9d429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1636769161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9192b0e7-c0a9-40f1-b23a-e137bffbf5f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=32d47f06-4ce3-4367-b330-b975dd341364,status='creating',terminated_at=None,updated_at=2026-06-23T18:20:47Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01accb0-48e2-4549-a75b-9a56e771ae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01accb0-48e2-4549-a75b-9a56e771ae7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f47589-82bb-44bd-acbb-5eb75dc7f12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f47589-82bb-44bd-acbb-5eb75dc7f12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9192b0e7-c0a9-40f1-b23a-e137bffbf5f9', 'volume_name': 'volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9', 'volume_size': 1, 'source_volid': '32d47f06-4ce3-4367-b330-b975dd341364', 'source_volstatus': 'available'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb14e5ab-b740-4757-81ef-8d1507e79787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb14e5ab-b740-4757-81ef-8d1507e79787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399eb832-c390-4b5d-a631-9fdc382418fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:20:46 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Volume 9192b0e7-c0a9-40f1-b23a-e137bffbf5f9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9', 'volume_size': 1, 'source_volid': '32d47f06-4ce3-4367-b330-b975dd341364', 'source_volstatus': 'available'} Jun 23 20:20:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:47 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 1 in 0.873s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.687s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.441s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Creating offline snapshot cac36e8d-9a90-4a12-9372-498ec9ce6eef of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[41efb9cd-0f29-4239-940d-f8225605c504]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-84a69d4f-1690-439f-8b53-510bcd315f46', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a00340f6-bf6c-420b-a222-9e03b0377161', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:20:47 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-22f96525-a1bf-480d-a1b0-174591cd6c00 tempest-TestInstancesWithCinderVolumes-2039171554 None] attachment_update completed successfully. Jun 23 20:20:47 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:20:47 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:47 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.755s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:20:47 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 0.826s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:20:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:47 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef 1G Jun 23 20:20:47 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:48 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef 1G" returned: 0 in 0.934s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:48 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef Jun 23 20:20:48 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:49 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef" returned: 0 in 0.845s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:49 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef is being set with open permissions: ugo+rw Jun 23 20:20:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:49 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef Jun 23 20:20:49 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-c23b49c5-6a0b-427e-a95e-6a61a4f42212 req-76ffaa6b-c7b6-423f-abf6-b818781ba735 tempest-AttachVolumeTestJSON-462274605 None] Terminate volume connection completed successfully. Jun 23 20:20:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c23b49c5-6a0b-427e-a95e-6a61a4f42212 req-76ffaa6b-c7b6-423f-abf6-b818781ba735 tempest-AttachVolumeTestJSON-462274605 None] Deleting attachment 88b658e2-f84d-43f5-ba30-279285d659ab. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:20:50 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef" returned: 0 in 0.783s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.500s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.668s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:50 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Cloning volume 32d47f06-4ce3-4367-b330-b975dd341364 to volume 9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 Jun 23 20:20:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b07a7988-9a4f-41db-8fac-25e76bb8fa0e tempest-SnapshotsActionsTest-1693159980 None] Create snapshot completed successfully Jun 23 20:20:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Creating offline snapshot 392f3014-9366-4bc1-9ef5-22d17253dc05 of volume 32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:20:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6d3764-d930-4577-b093-f5f51c36eeca]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:50 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 Jun 23 20:20:50 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-cac36e8d-9a90-4a12-9372-498ec9ce6eef-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-cac36e8d-9a90-4a12-9372-498ec9ce6eef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-quobyte-cac36e8d-9a90-4a12-9372-498ec9ce6eef" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-cac36e8d-9a90-4a12-9372-498ec9ce6eef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Deleting offline snapshot cac36e8d-9a90-4a12-9372-498ec9ce6eef of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] snapshot_file for this snap is: volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d714b4f-556d-432c-a708-0e250d0d4ee1]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:51 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef Jun 23 20:20:51 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:51 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364" returned: 0 in 0.910s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:51 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 1G Jun 23 20:20:51 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:52 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef" returned: 0 in 0.909s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:20:52 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9867cd29-169b-4d90-b97e-3bd99336552c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:52 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:20:52 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:52 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 1G" returned: 0 in 0.958s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d47f06-4ce3-4367-b330-b975dd341364 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:52 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d47f06-4ce3-4367-b330-b975dd341364 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 Jun 23 20:20:52 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:53 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 1.202s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:20:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:53 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef Jun 23 20:20:53 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:53 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-e6dd1865-657a-4511-abe2-3ba49dd31575 req-3d4c7dad-8fc4-49ef-a0d5-cd0231f53988 tempest-AttachVolumeTestJSON-462274605 None] Terminate volume connection completed successfully. Jun 23 20:20:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-e6dd1865-657a-4511-abe2-3ba49dd31575 req-3d4c7dad-8fc4-49ef-a0d5-cd0231f53988 tempest-AttachVolumeTestJSON-462274605 None] Deleting attachment f738e313-a1c4-48a2-a306-86d82690dac6. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:20:53 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d47f06-4ce3-4367-b330-b975dd341364 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05" returned: 0 in 1.199s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:53 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 is being set with open permissions: ugo+rw Jun 23 20:20:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:53 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 Jun 23 20:20:53 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:54 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef" returned: 0 in 1.284s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:54 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef Jun 23 20:20:54 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:55 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05" returned: 0 in 1.351s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:55 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.info Jun 23 20:20:55 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:55 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.cac36e8d-9a90-4a12-9372-498ec9ce6eef" returned: 0 in 0.945s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-cac36e8d-9a90-4a12-9372-498ec9ce6eef" released by "_delete_snapshot" :: held 4.467s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" released by "delete_snapshot" :: held 4.502s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:55 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Created reservations ['1d1ba45c-4ed0-4f76-8c6b-f32497e53468', 'df264a3d-e25f-4f39-b5e6-0d1fac449b1c', '65e6c59e-887e-4547-a173-50f82a935870', 'f6540b7f-d947-4a35-bbde-391ee56334c0'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:20:55 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Delete snapshot completed successfully. Jun 23 20:20:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d457134b-ee31-4cce-b13c-0c2cd9ccda89 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-cac36e8d-9a90-4a12-9372-498ec9ce6eef-delete_snapshot" released by "delete_snapshot" :: held 4.715s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:20:56 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-b5f2b6f0-07e7-4a4d-aa5b-10f5a28de4c1 tempest-TestInstancesWithCinderVolumes-2039171554 None] Terminate volume connection completed successfully. Jun 23 20:20:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-57efaf8b-f14e-4475-983b-fab7edc005c9 req-b5f2b6f0-07e7-4a4d-aa5b-10f5a28de4c1 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deleting attachment a00340f6-bf6c-420b-a222-9e03b0377161. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:20:56 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.info" returned: 0 in 0.970s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:56 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.info is being set with open permissions: ugo+rw Jun 23 20:20:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:56 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.info Jun 23 20:20:56 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:56 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.info" returned: 0 in 0.903s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] snapshot: 392f3014-9366-4bc1-9ef5-22d17253dc05, volume: 9192b0e7-c0a9-40f1-b23a-e137bffbf5f9, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d63df-47ad-4c57-a1d2-953cd2932334]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:20:57 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 Jun 23 20:20:57 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:58 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05" returned: 0 in 0.984s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d47f06-4ce3-4367-b330-b975dd341364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:20:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:20:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:20:58 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[25272ac9-0869-40b5-968b-c6da3e152c47]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:20:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:58 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 Jun 23 20:20:58 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:20:58 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jun 23 20:20:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364" returned: 0 in 0.897s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:20:59 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:20:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:20:59 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 Jun 23 20:20:59 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "cinder-84a69d4f-1690-439f-8b53-510bcd315f46-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-84a69d4f-1690-439f-8b53-510bcd315f46-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=103,cinder:UPDATE=87,cinder:INSERT=24,cinder:DELETE=10 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=95,cinder:INSERT=37,cinder:UPDATE=91,cinder:DELETE=8 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:21:05 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" returned: 0 in 6.140s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "cinder-quobyte-84a69d4f-1690-439f-8b53-510bcd315f46" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ba826d-0a71-42c7-b978-46685f545785]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-quobyte-84a69d4f-1690-439f-8b53-510bcd315f46" acquired by "delete_volume" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3ba275-8fbd-4643-9241-20ae80f91170]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:05 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 Jun 23 20:21:05 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:05 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:21:05 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "cinder-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "cinder-quobyte-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-quobyte-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff96b8ef-17ad-4db7-90f3-e13623aef018]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:05 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 Jun 23 20:21:05 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:06 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364" returned: 0 in 0.999s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:21:06 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Converted 1024.00 MB image at 166.73 MB/s Jun 23 20:21:06 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 is being set with open permissions: ugo+rw Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:06 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 Jun 23 20:21:06 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:06 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 0 in 0.991s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:06 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:21:06 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:06 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2" returned: 0 in 0.934s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:06 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2 Jun 23 20:21:06 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:06 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" returned: 0 in 0.697s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" released by "_copy_volume_from_snapshot" :: held 9.854s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-392f3014-9366-4bc1-9ef5-22d17253dc05" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-392f3014-9366-4bc1-9ef5-22d17253dc05" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Deleting offline snapshot 392f3014-9366-4bc1-9ef5-22d17253dc05 of volume 32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] snapshot_file for this snap is: volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0e312-128d-4770-9e5c-e1f880fb8a21]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:07 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 1 in 0.803s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:07 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 Jun 23 20:21:07 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:07 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46 Jun 23 20:21:07 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:07 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2" returned: 0 in 0.807s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-quobyte-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2" released by "delete_volume" :: held 1.797s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Created reservations ['84de76b3-4de0-4943-a299-673071629ef2', '5ccf29e4-459d-479e-95c1-7af570ab3baf', 'e9d0dd6b-9733-4fd4-b719-d2a2beb6d454', '4ae00e3b-28a0-4f53-b13e-de1203305ca8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:07 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:07 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:07 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-84a69d4f-1690-439f-8b53-510bcd315f46" returned: 0 in 0.684s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-quobyte-84a69d4f-1690-439f-8b53-510bcd315f46" released by "delete_volume" :: held 2.580s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:07 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05" returned: 0 in 0.824s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d47f06-4ce3-4367-b330-b975dd341364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[835dac2f-7a6c-4d77-872e-e3978b10f6cb]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:07 devstack cinder-volume[93739]: WARNING cinder.quota [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-222355807-1759099815 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-222355807-1759099815, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:21:07 devstack cinder-volume[93739]: WARNING cinder.quota [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-222355807-1759099815 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-222355807-1759099815, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "cinder-4615f2ca-dbf7-4be8-b9e8-f371653be099-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-4615f2ca-dbf7-4be8-b9e8-f371653be099-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Created reservations ['589acad7-ac59-46fe-929c-62330f2c6da5', '2961efa6-3afe-4f5e-9df4-bd4cb4db2e74', '110241c8-a57e-44e6-9a24-769126443b9e', 'b6c46268-4ae3-470f-a577-79e09211d9dd'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "cinder-quobyte-4615f2ca-dbf7-4be8-b9e8-f371653be099" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-quobyte-4615f2ca-dbf7-4be8-b9e8-f371653be099" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:07 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 Jun 23 20:21:07 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c33ab8-aad9-42a4-b257-7b271ba14fb6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:08 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:08 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:08 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 Jun 23 20:21:08 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "cinder-c7c4e175-b006-433e-9888-fef05c0a1fbb-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-c7c4e175-b006-433e-9888-fef05c0a1fbb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "cinder-quobyte-c7c4e175-b006-433e-9888-fef05c0a1fbb" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:08 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-quobyte-c7c4e175-b006-433e-9888-fef05c0a1fbb" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.881s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Deleted volume successfully. Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae191e4f-12b0-435f-b2b2-a7c9db279c89]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fe0f587e-756a-43e6-bf57-73220b2988bc tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-0944eae1-4cab-43bc-ba39-4f0c7aeee2a2-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:08 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb Jun 23 20:21:08 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:08 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364" returned: 0 in 0.943s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:08 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 Jun 23 20:21:08 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:08 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.877s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deleted volume successfully. Jun 23 20:21:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4bf451ed-2f75-429b-8202-f6163b48d880 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-84a69d4f-1690-439f-8b53-510bcd315f46-delete_volume" released by "delete_volume" :: held 3.902s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:09 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099" returned: 0 in 1.036s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:09 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099 Jun 23 20:21:09 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:09 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb" returned: 0 in 0.921s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:09 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb Jun 23 20:21:09 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:09 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05" returned: 0 in 0.935s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:09 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05 Jun 23 20:21:09 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:09 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4615f2ca-dbf7-4be8-b9e8-f371653be099" returned: 0 in 0.733s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-quobyte-4615f2ca-dbf7-4be8-b9e8-f371653be099" released by "delete_volume" :: held 1.824s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Created reservations ['f4d6e501-278c-4c94-b858-2d3e475778a8', 'a8c35fb0-6d18-451b-bb94-dd7da7e3eb89', '10622582-e432-42d6-8e97-ddcad517bf1c', '7384de8e-32ae-4750-b106-08d7f98165d3'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:10 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:10 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:10 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c7c4e175-b006-433e-9888-fef05c0a1fbb" returned: 0 in 0.780s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-quobyte-c7c4e175-b006-433e-9888-fef05c0a1fbb" released by "delete_volume" :: held 1.761s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "cinder-ee392c81-2240-42bb-8ed5-46ba55d871ed-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-ee392c81-2240-42bb-8ed5-46ba55d871ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:10 devstack cinder-volume[93739]: WARNING cinder.quota [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91148786-1384738351 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91148786-1384738351, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:21:10 devstack cinder-volume[93739]: WARNING cinder.quota [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91148786-1384738351 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91148786-1384738351, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "cinder-quobyte-ee392c81-2240-42bb-8ed5-46ba55d871ed" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Created reservations ['c68e3207-b9af-45ea-bf21-512756f587f5', 'fccbb815-725a-4b09-92b4-ae16854698ea', 'c45a6807-cc8a-4651-a0ee-3b2e2d6172f2', 'd7bf01c7-92a9-43e0-a748-3c4e17e5676a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-quobyte-ee392c81-2240-42bb-8ed5-46ba55d871ed" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:10 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f28cf24-1b1c-4e64-8429-dabdc1a7c4b4]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364.392f3014-9366-4bc1-9ef5-22d17253dc05" returned: 0 in 0.775s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-392f3014-9366-4bc1-9ef5-22d17253dc05" released by "_delete_snapshot" :: held 3.607s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.022s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:10 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.433s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:10 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399eb832-c390-4b5d-a631-9fdc382418fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9', 'volume_size': 1, 'source_volid': '32d47f06-4ce3-4367-b330-b975dd341364', 'source_volstatus': 'available'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddc8082-d1ff-45ac-bee7-31c9e232aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "cinder-8a21dace-0e80-4de2-be76-8dcf6e4059fd-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:10 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:10 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-8a21dace-0e80-4de2-be76-8dcf6e4059fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:10 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Volume volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 (9192b0e7-c0a9-40f1-b23a-e137bffbf5f9): created successfully Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddc8082-d1ff-45ac-bee7-31c9e232aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (145b04f8-1114-44cc-a56a-ac54ef8aa758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Creating offline snapshot 80fdac56-30fe-427e-bf84-a3622341add0 of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:21:10 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cd6451-b273-4304-8f55-9f437e1167de]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.851s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Deleted volume successfully. Jun 23 20:21:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b5a781ac-f6f1-49e1-ac8d-e8a2b5c9081f tempest-VolumesGetTest-989358559 None] Created volume successfully. Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "cinder-quobyte-8a21dace-0e80-4de2-be76-8dcf6e4059fd" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7f60732e-f410-4201-ae55-4cd9bb841851 tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-4615f2ca-dbf7-4be8-b9e8-f371653be099-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-quobyte-8a21dace-0e80-4de2-be76-8dcf6e4059fd" acquired by "delete_volume" :: waited 0.037s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37a7a3f-545f-408c-9871-ec4db85c0ca0]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:11 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:11 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:11 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd Jun 23 20:21:11 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:11 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed" returned: 0 in 1.115s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:11 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed Jun 23 20:21:11 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:11 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.014s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:11 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:11 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deleted volume successfully. Jun 23 20:21:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5d1caa6f-7883-45b1-9f5a-faec855b7201 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-c7c4e175-b006-433e-9888-fef05c0a1fbb-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:11 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 1.094s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:11 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 1G Jun 23 20:21:11 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:12 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd" returned: 0 in 1.064s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:12 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd Jun 23 20:21:12 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:12 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ee392c81-2240-42bb-8ed5-46ba55d871ed" returned: 0 in 0.847s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (5cee8f57-8bb8-4a90-8133-14c67cd26ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c6aa4d-0f86-4ccb-884f-190ca8e277f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-quobyte-ee392c81-2240-42bb-8ed5-46ba55d871ed" released by "delete_volume" :: held 2.052s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c6aa4d-0f86-4ccb-884f-190ca8e277f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:21:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-629403082',display_name='tempest-VolumesGetTest-Volume-49740303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:21:12Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5e87a0-8200-4e7d-9815-0938dc3a7e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5e87a0-8200-4e7d-9815-0938dc3a7e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06640a7-a05a-408f-a794-5bdea86eeec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06640a7-a05a-408f-a794-5bdea86eeec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2', 'volume_name': 'volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4038d3f4-d0a5-411b-9b75-2792e14f3327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4038d3f4-d0a5-411b-9b75-2792e14f3327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e4b530-e099-4271-a136-c3cecfd32971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:12 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Volume ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2', 'volume_size': 1} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Created reservations ['627e0db7-fb45-435f-8f40-c6796a4f718e', '06ad47ec-8bdc-45f6-9875-374884dd035d', '1c108fee-41cd-4b6b-80a1-fe262fc6e519', '38cfeb2f-5a91-4d2e-bec6-5e2acb934a23'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:12 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:12 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:12 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-8a21dace-0e80-4de2-be76-8dcf6e4059fd" returned: 0 in 0.890s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-quobyte-8a21dace-0e80-4de2-be76-8dcf6e4059fd" released by "delete_volume" :: held 2.034s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:13 devstack cinder-volume[93739]: WARNING cinder.quota [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-540576112-1931262155 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-540576112-1931262155, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:21:13 devstack cinder-volume[93739]: WARNING cinder.quota [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-540576112-1931262155 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-540576112-1931262155, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Created reservations ['cc2a9b88-67c4-43e8-8abe-760aba649073', '2fce25be-6844-4a91-a3c0-b989084e3e76', '5f2a485e-4f84-4185-ae7b-7e4cc3ff0c1c', '7c106b40-ba32-40e4-b8b8-c42b83275d42'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:13 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 1G" returned: 0 in 1.129s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:13 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 Jun 23 20:21:13 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:13 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:13 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:13 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.890s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:13 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Deleted volume successfully. Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-add56b49-3c01-4279-970e-bdc0dc39469a tempest-AttachVolumeTestJSON-462274605 None] Lock "cinder-ee392c81-2240-42bb-8ed5-46ba55d871ed-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:13 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.676s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:13 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Deleted volume successfully. Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c73a0ea-090f-4910-bf51-292164983173 tempest-TestInstancesWithCinderVolumes-2039171554 None] Lock "cinder-8a21dace-0e80-4de2-be76-8dcf6e4059fd-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:13 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0" returned: 0 in 0.860s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:13 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 is being set with open permissions: ugo+rw Jun 23 20:21:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:13 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 Jun 23 20:21:13 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:14 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0" returned: 0 in 0.884s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.294s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:21:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-629403082',display_name='tempest-VolumesGetTest-Volume-49740303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:21:12Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Creating volume ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:21:14 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:21:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:14 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 1073741824 Jun 23 20:21:14 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ab32bb31-1949-493c-8ab2-10e3ea261dd4 tempest-SnapshotsActionsTest-1693159980 None] Create snapshot completed successfully Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-80fdac56-30fe-427e-bf84-a3622341add0-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-80fdac56-30fe-427e-bf84-a3622341add0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-quobyte-80fdac56-30fe-427e-bf84-a3622341add0" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-80fdac56-30fe-427e-bf84-a3622341add0" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Deleting offline snapshot 80fdac56-30fe-427e-bf84-a3622341add0 of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] snapshot_file for this snap is: volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ae85d4-9fae-4e8a-a4a5-b68e44bdd918]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:15 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 Jun 23 20:21:15 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:15 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 1073741824" returned: 0 in 0.998s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:15 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 Jun 23 20:21:15 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:16 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0" returned: 0 in 0.860s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87230a-1749-4579-8f8c-cfb9f21dff11]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:16 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:16 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:16 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2" returned: 0 in 0.831s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e4b530-e099-4271-a136-c3cecfd32971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b61c8d0-9bdb-4c98-b019-5bab38990065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:16 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Volume volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 (ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2): created successfully Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b61c8d0-9bdb-4c98-b019-5bab38990065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (5cee8f57-8bb8-4a90-8133-14c67cd26ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:21:16 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-76ac900a-c8c3-44c7-a675-c86cb3532c2f tempest-VolumesGetTest-989358559 None] Created volume successfully. Jun 23 20:21:17 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 0.987s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:17 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 Jun 23 20:21:17 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Lock "cinder-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:18 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65fc062-7526-476b-a70f-0f21f894ff2b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:18 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 Jun 23 20:21:18 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:18 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0" returned: 0 in 1.285s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:18 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0 Jun 23 20:21:18 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:19 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2" returned: 0 in 1.253s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:19 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2 Jun 23 20:21:19 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:19 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.80fdac56-30fe-427e-bf84-a3622341add0" returned: 0 in 0.953s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-80fdac56-30fe-427e-bf84-a3622341add0" released by "_delete_snapshot" :: held 4.242s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" released by "delete_snapshot" :: held 4.310s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:19 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Created reservations ['f6b66dff-bed8-43fb-93df-5aa5e506a36e', '77151447-7833-45c1-900b-7db125043b5c', '2f9904a3-1095-4c62-868d-a2ce322e923b', '4961a697-9e09-420f-870f-bd00a3d1bd61'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:20 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Delete snapshot completed successfully. Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71e1a5c5-6e74-495c-aee9-e3bf46a356ac tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-80fdac56-30fe-427e-bf84-a3622341add0-delete_snapshot" released by "delete_snapshot" :: held 4.547s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:20 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2" returned: 0 in 0.827s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2" released by "delete_volume" :: held 2.140s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Created reservations ['6c41e1a0-8150-4d8e-97e0-d77e3debcadb', '91419828-3e03-4f3f-85c2-6f8da690a36b', '9390133c-be9a-47cb-b1a5-0ecba2db3024', '85402959-c111-487f-8b47-ce60464d43e5'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:20 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:20 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Creating offline snapshot 5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:21:21 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.018s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc993b09-ae94-49b7-b39e-b98373011f7e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Deleted volume successfully. Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-754d63b0-619d-4568-ab2a-73b4c2808cd7 tempest-VolumesGetTest-989358559 None] Lock "cinder-ece2d3e8-aa1e-4366-8818-6eaa8bfc9ba2-delete_volume" released by "delete_volume" :: held 3.478s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Lock "cinder-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:21 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:21 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[88108fe4-ca52-4772-8f0c-950cec3e15ff]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:21 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 Jun 23 20:21:21 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:22 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 1.275s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:22 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 1G Jun 23 20:21:22 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:22 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" returned: 0 in 1.106s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:22 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9 Jun 23 20:21:22 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:23 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" returned: 0 in 0.871s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9" released by "delete_volume" :: held 2.052s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:23 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 1G" returned: 0 in 1.125s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:23 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 Jun 23 20:21:23 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:23 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Created reservations ['8b14d1a8-b4cb-408e-aa1d-175898167c24', 'f58c52b8-bdce-44d3-92f3-fb1639323e56', '452b556a-427f-4bf8-98bc-b1d3694309c3', '52166729-597a-4db5-bae9-7e100863c7b9'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:24 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:24 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:24 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6" returned: 0 in 0.909s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:24 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 is being set with open permissions: ugo+rw Jun 23 20:21:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:24 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 Jun 23 20:21:24 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:24 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.932s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Deleted volume successfully. Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-415fc2fc-aaec-4c4a-b432-cdc771ff6308 tempest-VolumesGetTest-989358559 None] Lock "cinder-9192b0e7-c0a9-40f1-b23a-e137bffbf5f9-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-32d47f06-4ce3-4367-b330-b975dd341364-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Lock "cinder-32d47f06-4ce3-4367-b330-b975dd341364-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-32d47f06-4ce3-4367-b330-b975dd341364" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-32d47f06-4ce3-4367-b330-b975dd341364" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf4d8af-c670-4c7a-8c5d-f373b3efb1ea]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:25 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 Jun 23 20:21:25 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:25 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6" returned: 0 in 1.049s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.528s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2b5773d7-b927-4139-a009-ba5c88f49b9f tempest-SnapshotsActionsTest-1693159980 None] Create snapshot completed successfully Jun 23 20:21:26 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364" returned: 0 in 0.952s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:26 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364 Jun 23 20:21:26 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-5ca6ff33-3c02-4c3b-b485-b22fe2904fc6-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-5ca6ff33-3c02-4c3b-b485-b22fe2904fc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-quobyte-5ca6ff33-3c02-4c3b-b485-b22fe2904fc6" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-5ca6ff33-3c02-4c3b-b485-b22fe2904fc6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Deleting offline snapshot 5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] snapshot_file for this snap is: volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[75335a48-aeac-4ed6-9e78-a91c4fdce5d0]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:27 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 Jun 23 20:21:27 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:27 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-32d47f06-4ce3-4367-b330-b975dd341364" returned: 0 in 0.918s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-32d47f06-4ce3-4367-b330-b975dd341364" released by "delete_volume" :: held 1.955s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Created reservations ['b14408f3-9297-4bba-8758-5371e787f41d', '0dd5c50b-4e87-489d-84c2-3a5cac750988', '96613899-de11-4a1d-89c6-a9166b1b0be2', '7df67ac2-58b5-46eb-97aa-e9d781f4c5f1'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:27 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:27 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:28 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6" returned: 0 in 1.143s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5002d5ae-f77c-42c9-9920-a7e794b5b5df]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:28 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.757s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:28 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:28 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Deleted volume successfully. Jun 23 20:21:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-24cc361c-e212-4e90-b6d6-f52f2bd5eaca tempest-VolumesGetTest-989358559 None] Lock "cinder-32d47f06-4ce3-4367-b330-b975dd341364-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:28 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:28 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:29 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 1.358s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:29 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 Jun 23 20:21:29 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (a92cafd8-1be1-47a2-93ed-bcfff8e77f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62ae59b-bb62-42b2-b1a1-1e3a0dfe6a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62ae59b-bb62-42b2-b1a1-1e3a0dfe6a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1792334152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb36c16-7415-4ec4-801f-378812dcc908,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:21:30Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8e603a-e050-4e13-8d4f-638791668d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8e603a-e050-4e13-8d4f-638791668d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4ffd7c-1d95-439a-b7f1-cf7fcbc055a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:21:30 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6" returned: 0 in 1.328s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:30 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6 Jun 23 20:21:30 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4ffd7c-1d95-439a-b7f1-cf7fcbc055a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdb36c16-7415-4ec4-801f-378812dcc908', 'volume_name': 'volume-fdb36c16-7415-4ec4-801f-378812dcc908', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738c8d6f-eab9-4649-a685-6d522c90b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738c8d6f-eab9-4649-a685-6d522c90b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfde1e1-1550-488e-ba14-895934518e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:31 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Volume fdb36c16-7415-4ec4-801f-378812dcc908: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdb36c16-7415-4ec4-801f-378812dcc908', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Trying to clone fdb36c16-7415-4ec4-801f-378812dcc908 from image 8123ebb9-f4e0-4d01-974c-3920c780745e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:21:31 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Image download 20.69 MB at 20.69 MB/s Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6a2aba-c659-41a6-8d7c-170206ef7a77]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:31 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.5ca6ff33-3c02-4c3b-b485-b22fe2904fc6" returned: 0 in 1.123s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-5ca6ff33-3c02-4c3b-b485-b22fe2904fc6" released by "_delete_snapshot" :: held 5.122s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" released by "delete_snapshot" :: held 5.156s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:32 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD Jun 23 20:21:32 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:32 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Created reservations ['408c586f-f66d-4b19-b94c-d99700f60708', '2f3e7e50-daec-49eb-8bd4-30003820db35', '2c70df23-38f7-40e5-80af-86804952d680', '8dfdb1c7-1c20-4d14-a2eb-d94e9e7d99a2'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Delete snapshot completed successfully. Jun 23 20:21:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cb777b93-0e81-4ef3-a1a1-ac36d5d07be7 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-5ca6ff33-3c02-4c3b-b485-b22fe2904fc6-delete_snapshot" released by "delete_snapshot" :: held 5.425s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:32 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD" returned: 0 in 1.005s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:32 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Temporary image 8123ebb9-f4e0-4d01-974c-3920c780745e is fetched for user d0f7d4f4499140cca8d39380224649c5. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:21:33 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3228e45e-5522-45ba-931b-304fc4bc79ff]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:33 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD Jun 23 20:21:33 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Creating offline snapshot 1d2b85dc-d4c0-4951-aab5-26ce818311b0 of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:21:33 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d3ab07-aa19-4f13-a30e-fc171f2775e8]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:34 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:34 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:34 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD" returned: 0 in 1.056s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:34 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 0.990s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:34 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 1G Jun 23 20:21:34 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:36 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 1G" returned: 0 in 1.207s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:36 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 Jun 23 20:21:36 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:37 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0" returned: 0 in 1.045s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:37 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 is being set with open permissions: ugo+rw Jun 23 20:21:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:37 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 Jun 23 20:21:37 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:37 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0" returned: 0 in 0.855s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.265s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.946s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1792334152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb36c16-7415-4ec4-801f-378812dcc908,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:21:30Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Creating volume fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:21:38 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:21:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:38 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 1073741824 Jun 23 20:21:38 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:38 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0b8f2307-53c8-4282-b2f3-ade899ad58ce tempest-SnapshotsActionsTest-1693159980 None] Create snapshot completed successfully Jun 23 20:21:39 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 1073741824" returned: 0 in 1.320s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-1d2b85dc-d4c0-4951-aab5-26ce818311b0-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-1d2b85dc-d4c0-4951-aab5-26ce818311b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Acquiring lock "cinder-quobyte-1d2b85dc-d4c0-4951-aab5-26ce818311b0" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-1d2b85dc-d4c0-4951-aab5-26ce818311b0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Deleting offline snapshot 1d2b85dc-d4c0-4951-aab5-26ce818311b0 of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:21:39 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 Jun 23 20:21:39 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] snapshot_file for this snap is: volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba3e66-9927-4b75-afd7-e13c9dc1d5b9]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:39 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 Jun 23 20:21:39 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:40 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0" returned: 0 in 0.901s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:40 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908" returned: 0 in 1.081s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] <== create_volume: return (2501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.509s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ff9ee6-c07c-4501-a6ca-8727c51b2a51]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Attempting download of 8123ebb9-f4e0-4d01-974c-3920c780745e ((None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}])) to volume fdb36c16-7415-4ec4-801f-378812dcc908. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af3d19-b3b5-436f-91a7-2281049b6898]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_ld0y7rip {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:40 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:40 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:40 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_ld0y7rip Jun 23 20:21:40 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:41 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 0.971s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:41 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 Jun 23 20:21:41 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:41 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_ld0y7rip" returned: 0 in 0.978s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_ld0y7rip {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:41 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_ld0y7rip Jun 23 20:21:41 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:42 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_ld0y7rip" returned: 1 in 0.967s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_ld0y7rip' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:21:42 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8eb22a-66dd-4205-a96e-c1f320d12281]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:42 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0" returned: 0 in 1.163s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:42 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0 Jun 23 20:21:42 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:42 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD Jun 23 20:21:42 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:43 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD" returned: 0 in 0.929s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:43 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] 8123ebb9-f4e0-4d01-974c-3920c780745e was qcow2, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:21:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:43 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 Jun 23 20:21:43 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:43 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.1d2b85dc-d4c0-4951-aab5-26ce818311b0" returned: 0 in 1.012s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-1d2b85dc-d4c0-4951-aab5-26ce818311b0" released by "_delete_snapshot" :: held 4.255s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" released by "delete_snapshot" :: held 4.291s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:43 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Created reservations ['46de2747-64f6-4725-b156-db0eadee4d27', '03db23c6-e72e-4e96-9810-9dbf75c2f936', 'c9827536-b730-46b8-924a-8589eb059f5d', '0fc83ae3-922e-4ab9-99a1-a7152232d39e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Delete snapshot completed successfully. Jun 23 20:21:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c032335-4ae8-482b-ae5a-eb507d97f916 tempest-SnapshotsActionsTest-671795575 None] Lock "cinder-1d2b85dc-d4c0-4951-aab5-26ce818311b0-delete_snapshot" released by "delete_snapshot" :: held 4.526s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "cinder-d02752eb-721d-4b58-88bf-d67e385f45b1-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-d02752eb-721d-4b58-88bf-d67e385f45b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "cinder-quobyte-d02752eb-721d-4b58-88bf-d67e385f45b1" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-quobyte-d02752eb-721d-4b58-88bf-d67e385f45b1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Deleting offline snapshot d02752eb-721d-4b58-88bf-d67e385f45b1 of volume d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] snapshot_file for this snap is: volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa23f90-a8ae-4b4f-a6d5-50aa259e454c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:45 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:45 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:46 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908" returned: 0 in 2.944s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_xwyql1j_devstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:21:46 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Converted 112.00 MB image at 38.02 MB/s Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:46 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 1G Jun 23 20:21:46 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:46 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:46 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:46 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 1.160s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[330538df-e05d-4079-9131-e5b75dddc64b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:46 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae Jun 23 20:21:46 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:47 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 1G" returned: 0 in 1.080s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe84da2-cab7-4d46-8d65-19ea6ffb822b]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:47 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 Jun 23 20:21:47 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:47 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.148s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:21:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:21:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:21:48 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" returned: 0 in 1.280s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:48 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:48 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:48 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908" returned: 0 in 0.931s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:48 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 Jun 23 20:21:48 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:48 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 0.894s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:49 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1 Jun 23 20:21:49 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:49 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908" returned: 1 in 0.885s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Downloaded image 8123ebb9-f4e0-4d01-974c-3920c780745e ((None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}])) to volume fdb36c16-7415-4ec4-801f-378812dcc908 successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Temporary image 8123ebb9-f4e0-4d01-974c-3920c780745e for user d0f7d4f4499140cca8d39380224649c5 is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Marking volume fdb36c16-7415-4ec4-801f-378812dcc908 as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Copying metadata from image 8123ebb9-f4e0-4d01-974c-3920c780745e to fdb36c16-7415-4ec4-801f-378812dcc908. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Creating volume glance metadata for volume fdb36c16-7415-4ec4-801f-378812dcc908 backed by image 8123ebb9-f4e0-4d01-974c-3920c780745e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfde1e1-1550-488e-ba14-895934518e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb36c16-7415-4ec4-801f-378812dcc908', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba839c2c-302c-4ce2-a54a-a9d974c7e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:49 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Volume volume-fdb36c16-7415-4ec4-801f-378812dcc908 (fdb36c16-7415-4ec4-801f-378812dcc908): created successfully Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba839c2c-302c-4ce2-a54a-a9d974c7e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (a92cafd8-1be1-47a2-93ed-bcfff8e77f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:21:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-15f5bfe7-4ff6-4436-8f2e-caa6b967c833 tempest-VolumesGetTest-989358559 None] Created volume successfully. Jun 23 20:21:49 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae.d02752eb-721d-4b58-88bf-d67e385f45b1" returned: 0 in 0.813s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-quobyte-d02752eb-721d-4b58-88bf-d67e385f45b1" released by "_delete_snapshot" :: held 4.322s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" released by "delete_snapshot" :: held 4.351s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Created reservations ['34d62110-88fd-426b-a57f-7ad6d82042b1', 'ae5e06e2-c790-4aa3-999f-d9cfb937af9c', '35526c5d-01e5-4ad4-ae5e-3958b7931074', 'b28591fc-53da-4e69-b302-08aa6bef80d8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Delete snapshot completed successfully. Jun 23 20:21:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3129c1f2-995f-4124-8f83-275e61a0c23c tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-d02752eb-721d-4b58-88bf-d67e385f45b1-delete_snapshot" released by "delete_snapshot" :: held 4.517s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "cinder-d118fd08-d2d7-4787-b597-cfe3ae2d37ae-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-d118fd08-d2d7-4787-b597-cfe3ae2d37ae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" acquired by "delete_volume" :: waited 0.047s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (3c8499bf-8997-4c60-8c2a-87085f13b1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ff215-a9d4-4644-86be-9d1e36b52273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bd8da8-3212-4917-ae3d-325b60f513fd]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ff215-a9d4-4644-86be-9d1e36b52273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:21:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-12038558',display_name='tempest-VolumesGetTest-Volume-629571880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:21:51Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01dd4e2a-90cc-4804-b3ab-f6fa57029e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01dd4e2a-90cc-4804-b3ab-f6fa57029e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae599bf-6002-46a3-8250-8366e379d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae599bf-6002-46a3-8250-8366e379d874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b', 'volume_name': 'volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5d500b-87bf-43e6-bf94-adc7ce04854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5d500b-87bf-43e6-bf94-adc7ce04854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0e3063-b902-4877-a1bc-fba05a78f95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:51 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Volume 4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b', 'volume_size': 1} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:21:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-12038558',display_name='tempest-VolumesGetTest-Volume-629571880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d786ec43e4485c83ce7104bdc4d396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:21:51Z,use_quota=True,user_id='d0f7d4f4499140cca8d39380224649c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Creating volume 4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:21:51 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:21:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:51 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b 1073741824 Jun 23 20:21:51 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:51 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae Jun 23 20:21:51 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:52 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" returned: 0 in 1.216s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:52 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae Jun 23 20:21:52 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:52 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b 1073741824" returned: 0 in 1.237s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:52 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b Jun 23 20:21:52 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:53 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" returned: 0 in 1.135s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-quobyte-d118fd08-d2d7-4787-b597-cfe3ae2d37ae" released by "delete_volume" :: held 2.461s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Created reservations ['20ae14cb-fc91-4dd5-818c-a58979f67120', '646429cb-ba3f-47d7-9ee1-1f0846bfd215', '8e1fcf1b-c6eb-46fb-8d37-44212030bd6d', '7523d06a-c45e-4984-85a2-53591d7b22d9'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:53 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b" returned: 0 in 1.265s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] <== create_volume: return (2560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.563s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0e3063-b902-4877-a1bc-fba05a78f95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:53 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:53 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4dfe42-15e1-40fb-9719-8db8d8808839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:21:53 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Volume volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b (4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b): created successfully Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4dfe42-15e1-40fb-9719-8db8d8808839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:21:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Flow 'volume_create_manager' (3c8499bf-8997-4c60-8c2a-87085f13b1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:21:53 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-386981a1-29b5-48f0-9997-a197c6c227a3 tempest-VolumesGetTest-989358559 None] Created volume successfully. Jun 23 20:21:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Lock "cinder-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:54 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca55edc-f422-4b71-8e02-908ba7ac2723]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:54 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.220s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:54 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:55 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Deleted volume successfully. Jun 23 20:21:55 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b Jun 23 20:21:55 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3a41deff-d71c-4fb0-910b-8deb0a190128 tempest-SnapshotsActionsTest-1693159980 None] Lock "cinder-d118fd08-d2d7-4787-b597-cfe3ae2d37ae-delete_volume" released by "delete_volume" :: held 4.081s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:56 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b" returned: 0 in 1.250s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:56 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b Jun 23 20:21:56 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:57 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b" returned: 0 in 0.992s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b" released by "delete_volume" :: held 2.317s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Created reservations ['01943ae4-bf53-4b74-a129-3434ef3e8b69', 'cfdfb850-6411-4b28-82b8-128fd4af2a1b', '41f680ac-1686-4f0c-8119-4ec1614e9df8', '2cd12618-28d3-4819-adaf-a07dffc371af'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:21:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:57 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:21:57 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:57 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.749s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:21:58 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Deleted volume successfully. Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e8411fcc-c893-458a-9257-b3349f5e9e57 tempest-VolumesGetTest-989358559 None] Lock "cinder-4b529cc2-a8f3-4fdf-b7ef-6d7bb44f098b-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-fdb36c16-7415-4ec4-801f-378812dcc908-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Lock "cinder-fdb36c16-7415-4ec4-801f-378812dcc908-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Acquiring lock "cinder-quobyte-fdb36c16-7415-4ec4-801f-378812dcc908" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-fdb36c16-7415-4ec4-801f-378812dcc908" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040cf5c-7c5b-4ee3-b8d9-b7b0f90bca01]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:21:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:58 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 Jun 23 20:21:58 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:21:59 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jun 23 20:21:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908" returned: 0 in 0.904s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:21:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:21:59 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 Jun 23 20:21:59 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:00 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908" returned: 1 in 1.083s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:22:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:00 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908 Jun 23 20:22:00 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Flow 'volume_create_manager' (071d9e68-6a22-4a83-b904-d0c06a26fbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dca2c76-26da-4aa2-a1f9-81a057382ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dca2c76-26da-4aa2-a1f9-81a057382ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-255358761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767ab74b-238d-4a13-afe3-aed97e60cbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be54b1ae06484b67b7631019f1a3577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:01Z,use_quota=True,user_id='cfc64fca293a48a0b27c44a239d6022c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91d99a7-962e-4b37-a7e5-fa539ab0cda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91d99a7-962e-4b37-a7e5-fa539ab0cda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc1929a-80bd-4836-8add-bce68ff0d4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc1929a-80bd-4836-8add-bce68ff0d4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767ab74b-238d-4a13-afe3-aed97e60cbd6', 'volume_name': 'volume-767ab74b-238d-4a13-afe3-aed97e60cbd6', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38baf41-0d9b-40b7-9ae5-9a0e74fb01b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38baf41-0d9b-40b7-9ae5-9a0e74fb01b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6228101-b3ce-4a28-8d86-dd44a096c2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Volume 767ab74b-238d-4a13-afe3-aed97e60cbd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767ab74b-238d-4a13-afe3-aed97e60cbd6', 'volume_size': 1} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-255358761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767ab74b-238d-4a13-afe3-aed97e60cbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be54b1ae06484b67b7631019f1a3577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:01Z,use_quota=True,user_id='cfc64fca293a48a0b27c44a239d6022c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Creating volume 767ab74b-238d-4a13-afe3-aed97e60cbd6 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:01 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:01 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 1073741824 Jun 23 20:22:01 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:01 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fdb36c16-7415-4ec4-801f-378812dcc908" returned: 0 in 0.944s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Lock "cinder-quobyte-fdb36c16-7415-4ec4-801f-378812dcc908" released by "delete_volume" :: held 3.009s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Created reservations ['681e820f-3011-4bda-a84c-4b1732ef711f', 'fcb3789d-2b71-49ee-b372-e439480b7d40', 'd516b418-78cf-48de-af81-13859023a147', '9cf4f55b-a4ca-4225-a2f2-99bbb033ea8a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:01 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:22:01 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Flow 'volume_create_manager' (8e4ab3ab-df33-4bed-bde0-4f770fd6957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda191ce-a22c-4993-a965-ef1cc188b139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda191ce-a22c-4993-a965-ef1cc188b139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-529789798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cef7f2d-901b-490e-b388-771dc83d24cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be54b1ae06484b67b7631019f1a3577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:02Z,use_quota=True,user_id='cfc64fca293a48a0b27c44a239d6022c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065ee568-9fc4-4be5-a0db-6f250895e1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065ee568-9fc4-4be5-a0db-6f250895e1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36226e69-5c6e-4754-ae76-129a1e3f8cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36226e69-5c6e-4754-ae76-129a1e3f8cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cef7f2d-901b-490e-b388-771dc83d24cf', 'volume_name': 'volume-6cef7f2d-901b-490e-b388-771dc83d24cf', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c75f06-54ed-4262-b4e3-f0256d97c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c75f06-54ed-4262-b4e3-f0256d97c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806a1a35-c7f9-4ffe-93d2-8d0d3a08937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:01 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Volume 6cef7f2d-901b-490e-b388-771dc83d24cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cef7f2d-901b-490e-b388-771dc83d24cf', 'volume_size': 1} Jun 23 20:22:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:02 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.905s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:02 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:22:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Deleted volume successfully. Jun 23 20:22:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-55dbc711-9e35-4694-8b64-b858605e026d tempest-VolumesGetTest-989358559 None] Lock "cinder-fdb36c16-7415-4ec4-801f-378812dcc908-delete_volume" released by "delete_volume" :: held 4.351s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:02 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 1073741824" returned: 0 in 1.636s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:02 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 Jun 23 20:22:02 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:03 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6" returned: 0 in 1.005s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] <== create_volume: return (2698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.703s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.987s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-529789798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cef7f2d-901b-490e-b388-771dc83d24cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be54b1ae06484b67b7631019f1a3577e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:02Z,use_quota=True,user_id='cfc64fca293a48a0b27c44a239d6022c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Creating volume 6cef7f2d-901b-490e-b388-771dc83d24cf {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:03 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6228101-b3ce-4a28-8d86-dd44a096c2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767ab74b-238d-4a13-afe3-aed97e60cbd6', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:04 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf 1073741824 Jun 23 20:22:04 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc4bf9-53d7-47f5-8894-8b6d1c5a69ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:04 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Volume volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 (767ab74b-238d-4a13-afe3-aed97e60cbd6): created successfully Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc4bf9-53d7-47f5-8894-8b6d1c5a69ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Flow 'volume_create_manager' (071d9e68-6a22-4a83-b904-d0c06a26fbb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:04 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-247a1427-2b88-4941-bd37-bc6c27830995 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Created volume successfully. Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Flow 'volume_create_manager' (4780e08d-e4a2-45e8-a111-2973737ff922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70602913-3e7d-49ce-a731-899a3e31bd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70602913-3e7d-49ce-a731-899a3e31bd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-392356338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df38402-f63d-440c-8fd3-7319335918e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784e2af20c9f43078745e742b465cf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:04Z,use_quota=True,user_id='0deaf729e08a424b88d8b1ae94c77cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41627b27-1a55-4ac4-925b-69cbb030107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41627b27-1a55-4ac4-925b-69cbb030107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c776cf-3153-4747-bfb8-0840a4fef745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c776cf-3153-4747-bfb8-0840a4fef745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df38402-f63d-440c-8fd3-7319335918e7', 'volume_name': 'volume-5df38402-f63d-440c-8fd3-7319335918e7', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe9e162-bbaa-4cd8-91ee-77f94f571133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe9e162-bbaa-4cd8-91ee-77f94f571133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d13e807-ccb8-468a-9205-19e585f2d2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:04 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Volume 5df38402-f63d-440c-8fd3-7319335918e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df38402-f63d-440c-8fd3-7319335918e7', 'volume_size': 1} Jun 23 20:22:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:05 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf 1073741824" returned: 0 in 1.630s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:05 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=100,cinder:UPDATE=137,cinder:INSERT=40,cinder:DELETE=12 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:22:05 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=141,cinder:SELECT=110,cinder:INSERT=42,cinder:DELETE=8 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:22:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:05 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf Jun 23 20:22:05 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:06 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf" returned: 0 in 0.825s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.557s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.675s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-392356338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df38402-f63d-440c-8fd3-7319335918e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784e2af20c9f43078745e742b465cf42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:04Z,use_quota=True,user_id='0deaf729e08a424b88d8b1ae94c77cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Creating volume 5df38402-f63d-440c-8fd3-7319335918e7 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:06 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:06 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 1073741824 Jun 23 20:22:06 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806a1a35-c7f9-4ffe-93d2-8d0d3a08937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cef7f2d-901b-490e-b388-771dc83d24cf', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb8c301-d53c-4295-93ea-c0963df0727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:06 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Volume volume-6cef7f2d-901b-490e-b388-771dc83d24cf (6cef7f2d-901b-490e-b388-771dc83d24cf): created successfully Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb8c301-d53c-4295-93ea-c0963df0727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Flow 'volume_create_manager' (8e4ab3ab-df33-4bed-bde0-4f770fd6957c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:06 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5c73bbca-a19b-4150-8061-a7a8d7aeb74f tempest-TestServerVolumeAttachmentScenario-2034216832 None] Created volume successfully. Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Flow 'volume_create_manager' (8ff50239-c85c-4af5-8e1c-b1685c595651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0056b3a7-da37-4b17-9677-110287a0eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0056b3a7-da37-4b17-9677-110287a0eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-734648527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6048ebe3-7e0c-4eda-b959-0b65bc349dc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e076bdb1733d44169d6fe8c8c3b2d40f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:07Z,use_quota=True,user_id='d75c893a25124d5daa7f3a7db090d28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161f6467-403e-4712-b764-334badc1f3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161f6467-403e-4712-b764-334badc1f3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aadaea9-ecb5-47c9-a8af-e87a3dbb36ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aadaea9-ecb5-47c9-a8af-e87a3dbb36ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6048ebe3-7e0c-4eda-b959-0b65bc349dc1', 'volume_name': 'volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f8b672-689c-4c3a-8a37-9da5279fec5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f8b672-689c-4c3a-8a37-9da5279fec5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670e05db-2899-4a22-bb7e-5b3255db8108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:07 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Volume 6048ebe3-7e0c-4eda-b959-0b65bc349dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1', 'volume_size': 1} Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:07 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 1073741824" returned: 0 in 1.436s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:08 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 Jun 23 20:22:08 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:08 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7" returned: 0 in 0.789s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] <== create_volume: return (2328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.210s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-734648527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6048ebe3-7e0c-4eda-b959-0b65bc349dc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e076bdb1733d44169d6fe8c8c3b2d40f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:07Z,use_quota=True,user_id='d75c893a25124d5daa7f3a7db090d28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Creating volume 6048ebe3-7e0c-4eda-b959-0b65bc349dc1 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:08 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:08 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 1073741824 Jun 23 20:22:08 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d13e807-ccb8-468a-9205-19e585f2d2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df38402-f63d-440c-8fd3-7319335918e7', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b8d1aa-1d4e-4c18-8ccc-e6d3c54f6e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:08 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Volume volume-5df38402-f63d-440c-8fd3-7319335918e7 (5df38402-f63d-440c-8fd3-7319335918e7): created successfully Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b8d1aa-1d4e-4c18-8ccc-e6d3c54f6e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Flow 'volume_create_manager' (4780e08d-e4a2-45e8-a111-2973737ff922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bb7b4ca6-d6e3-4983-a3f6-c5a88c2d355b tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Created volume successfully. Jun 23 20:22:09 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 1073741824" returned: 0 in 1.134s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:10 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 Jun 23 20:22:10 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:11 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1" returned: 0 in 1.010s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670e05db-2899-4a22-bb7e-5b3255db8108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7affe549-b1f2-4452-8fa6-96db42070a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:11 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Volume volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 (6048ebe3-7e0c-4eda-b959-0b65bc349dc1): created successfully Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7affe549-b1f2-4452-8fa6-96db42070a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Flow 'volume_create_manager' (8ff50239-c85c-4af5-8e1c-b1685c595651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:11 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c555d434-7f0c-452a-9c14-bbe8fffa2f5f tempest-VolumesListTestJSON-1299322144 None] Created volume successfully. Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Acquiring lock "cinder-5df38402-f63d-440c-8fd3-7319335918e7-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "cinder-5df38402-f63d-440c-8fd3-7319335918e7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Acquiring lock "cinder-quobyte-5df38402-f63d-440c-8fd3-7319335918e7" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "cinder-quobyte-5df38402-f63d-440c-8fd3-7319335918e7" acquired by "delete_volume" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf650a-85ed-4883-99a7-a33e3a6706c2]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:11 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 Jun 23 20:22:11 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:12 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Flow 'volume_create_manager' (1766ff69-5713-49b9-88b1-e355ffba0145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f931e3c6-3f84-4188-bf6e-3b7fa75c95a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7" returned: 0 in 1.097s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f931e3c6-3f84-4188-bf6e-3b7fa75c95a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1825337670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60deaaa-f74c-48e4-99a5-d7767441d6cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e076bdb1733d44169d6fe8c8c3b2d40f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:12Z,use_quota=True,user_id='d75c893a25124d5daa7f3a7db090d28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e7dab0-6743-4474-b85f-42499e1a169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e7dab0-6743-4474-b85f-42499e1a169d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:12 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7 Jun 23 20:22:12 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff835d9-11d7-4151-a6e6-bb0a5bc2bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff835d9-11d7-4151-a6e6-bb0a5bc2bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60deaaa-f74c-48e4-99a5-d7767441d6cb', 'volume_name': 'volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fd6df7-a7d3-467f-99c3-7090cb43b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fd6df7-a7d3-467f-99c3-7090cb43b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28de448-3b1d-46f6-bf15-8d27b3b16453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:12 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Volume a60deaaa-f74c-48e4-99a5-d7767441d6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb', 'volume_size': 1} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1825337670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60deaaa-f74c-48e4-99a5-d7767441d6cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e076bdb1733d44169d6fe8c8c3b2d40f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:12Z,use_quota=True,user_id='d75c893a25124d5daa7f3a7db090d28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Creating volume a60deaaa-f74c-48e4-99a5-d7767441d6cb {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:12 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:12 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb 1073741824 Jun 23 20:22:12 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:13 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5df38402-f63d-440c-8fd3-7319335918e7" returned: 0 in 0.885s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "cinder-quobyte-5df38402-f63d-440c-8fd3-7319335918e7" released by "delete_volume" :: held 2.027s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Created reservations ['bc4d42d7-e770-4626-8930-0d70523d4233', 'e55e3cdd-3e0d-4d29-b862-6b3b04de713a', '142f326a-90c0-4f49-9341-664b0957c2e6', '58209201-f4ff-43f3-a991-31bdcafe7189'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:13 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:22:13 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:14 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb 1073741824" returned: 0 in 1.416s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:14 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb Jun 23 20:22:14 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:15 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb" returned: 0 in 1.226s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.818s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28de448-3b1d-46f6-bf15-8d27b3b16453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1794456-a9f3-4d61-9c93-bf4f96974dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Volume volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb (a60deaaa-f74c-48e4-99a5-d7767441d6cb): created successfully Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1794456-a9f3-4d61-9c93-bf4f96974dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Flow 'volume_create_manager' (1766ff69-5713-49b9-88b1-e355ffba0145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-eb022a1e-47f8-4674-b1dc-3754505996a1 tempest-VolumesListTestJSON-1299322144 None] Created volume successfully. Jun 23 20:22:15 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.877s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:22:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Deleted volume successfully. Jun 23 20:22:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-65d745f0-d49b-4d7f-89ac-59ec8df7ef73 tempest-VolumeQuotasNegativeTestJSON-1087271189 None] Lock "cinder-5df38402-f63d-440c-8fd3-7319335918e7-delete_volume" released by "delete_volume" :: held 4.222s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Flow 'volume_create_manager' (9902c32a-db76-4c08-913c-cc78fce5d110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40644f6-e2ca-4b88-b832-5ad949c39d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40644f6-e2ca-4b88-b832-5ad949c39d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2002015738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288191bb-92b2-4b45-ac00-06d79484e6dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e076bdb1733d44169d6fe8c8c3b2d40f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:17Z,use_quota=True,user_id='d75c893a25124d5daa7f3a7db090d28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fea151-34d3-4887-8701-5a5804502568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fea151-34d3-4887-8701-5a5804502568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822af514-f285-4c45-ae9a-c78c85006531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822af514-f285-4c45-ae9a-c78c85006531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '288191bb-92b2-4b45-ac00-06d79484e6dd', 'volume_name': 'volume-288191bb-92b2-4b45-ac00-06d79484e6dd', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd08a7a4-faa4-4c49-a570-7e592cd74226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd08a7a4-faa4-4c49-a570-7e592cd74226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a8482c-cb79-485f-b092-e294afedac9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:16 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Volume 288191bb-92b2-4b45-ac00-06d79484e6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-288191bb-92b2-4b45-ac00-06d79484e6dd', 'volume_size': 1} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2002015738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288191bb-92b2-4b45-ac00-06d79484e6dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e076bdb1733d44169d6fe8c8c3b2d40f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:17Z,use_quota=True,user_id='d75c893a25124d5daa7f3a7db090d28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Creating volume 288191bb-92b2-4b45-ac00-06d79484e6dd {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:16 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:16 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd 1073741824 Jun 23 20:22:16 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:18 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd 1073741824" returned: 0 in 1.236s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:18 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd Jun 23 20:22:18 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:19 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd" returned: 0 in 0.882s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a8482c-cb79-485f-b092-e294afedac9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-288191bb-92b2-4b45-ac00-06d79484e6dd', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98b3948-fe8e-4ba4-8656-fc927479730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:19 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Volume volume-288191bb-92b2-4b45-ac00-06d79484e6dd (288191bb-92b2-4b45-ac00-06d79484e6dd): created successfully Jun 23 20:22:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98b3948-fe8e-4ba4-8656-fc927479730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Flow 'volume_create_manager' (9902c32a-db76-4c08-913c-cc78fce5d110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:19 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d9867fa4-b4cf-4e78-920c-b06247c8535c tempest-VolumesListTestJSON-1299322144 None] Created volume successfully. Jun 23 20:22:21 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Flow 'volume_create_manager' (37886140-a4c4-4499-8fb3-a81e70d06cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5311fb2-0e7e-4df3-87f1-4deb83ff8d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5311fb2-0e7e-4df3-87f1-4deb83ff8d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1015467641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7214eab9-5471-4f8f-842f-0eeff298ed15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c3b6e07dba4681a3db41374e073ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:22Z,use_quota=True,user_id='a10bcffbb06a44cc885ea7d9a0b37c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(506da301-2b6e-452a-a40a-0f46a01a958c),volume_type_id=506da301-2b6e-452a-a40a-0f46a01a958c)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e54b05-551e-4c11-8718-baf511d9352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e54b05-551e-4c11-8718-baf511d9352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce027df8-2da4-4552-bd84-769fa1e9af00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce027df8-2da4-4552-bd84-769fa1e9af00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7214eab9-5471-4f8f-842f-0eeff298ed15', 'volume_name': 'volume-7214eab9-5471-4f8f-842f-0eeff298ed15', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3770d0-20b0-4b17-8dea-6f0214e1394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3770d0-20b0-4b17-8dea-6f0214e1394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb89ff66-06d6-4715-b628-3742059afc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:22 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Volume 7214eab9-5471-4f8f-842f-0eeff298ed15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7214eab9-5471-4f8f-842f-0eeff298ed15', 'volume_size': 1} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1015467641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7214eab9-5471-4f8f-842f-0eeff298ed15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c3b6e07dba4681a3db41374e073ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:22Z,use_quota=True,user_id='a10bcffbb06a44cc885ea7d9a0b37c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(506da301-2b6e-452a-a40a-0f46a01a958c),volume_type_id=506da301-2b6e-452a-a40a-0f46a01a958c)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Creating volume 7214eab9-5471-4f8f-842f-0eeff298ed15 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:22 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:22 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 1073741824 Jun 23 20:22:22 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "cinder-288191bb-92b2-4b45-ac00-06d79484e6dd-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-288191bb-92b2-4b45-ac00-06d79484e6dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "cinder-quobyte-288191bb-92b2-4b45-ac00-06d79484e6dd" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-quobyte-288191bb-92b2-4b45-ac00-06d79484e6dd" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[89080bd5-ec26-48e7-9322-848ab4c5eb07]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:22 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd Jun 23 20:22:22 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:23 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 1073741824" returned: 0 in 1.269s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:23 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 Jun 23 20:22:23 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:23 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd" returned: 0 in 1.102s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:23 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd Jun 23 20:22:23 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:24 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15" returned: 0 in 0.947s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] <== create_volume: return (2299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb89ff66-06d6-4715-b628-3742059afc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7214eab9-5471-4f8f-842f-0eeff298ed15', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba1d3e6-9854-4faf-9ef5-a0268a549091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:24 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Volume volume-7214eab9-5471-4f8f-842f-0eeff298ed15 (7214eab9-5471-4f8f-842f-0eeff298ed15): created successfully Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba1d3e6-9854-4faf-9ef5-a0268a549091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Flow 'volume_create_manager' (37886140-a4c4-4499-8fb3-a81e70d06cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:24 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8fc1d3e5-816e-477d-a2a1-3e1d8b66896f tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Created volume successfully. Jun 23 20:22:24 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-288191bb-92b2-4b45-ac00-06d79484e6dd" returned: 0 in 1.119s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-quobyte-288191bb-92b2-4b45-ac00-06d79484e6dd" released by "delete_volume" :: held 2.282s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Created reservations ['0d37923e-3a66-46f3-8bd1-44fe4e5205b2', '660d2bea-b6d6-442a-af1d-f44806185d84', '7a2aa753-69d4-4d71-91fc-fa5c1e2abd09', 'ac8836b1-70aa-4499-9895-504321074dd8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:24 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:22:24 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:25 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.777s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:22:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Deleted volume successfully. Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad9734e3-b0c8-406b-b0fb-4dc983445e6d tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-288191bb-92b2-4b45-ac00-06d79484e6dd-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:25 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:22:25 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "cinder-a60deaaa-f74c-48e4-99a5-d7767441d6cb-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-a60deaaa-f74c-48e4-99a5-d7767441d6cb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "cinder-quobyte-a60deaaa-f74c-48e4-99a5-d7767441d6cb" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-quobyte-a60deaaa-f74c-48e4-99a5-d7767441d6cb" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:26 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[46570d1c-f35a-4f84-b81c-e0483e448482]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:26 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb Jun 23 20:22:26 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:26 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.866s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:26 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:22:26 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3333b0a7-8995-4735-a3e9-64861b46be68 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Retype volume completed successfully. Jun 23 20:22:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Acquiring lock "cinder-7214eab9-5471-4f8f-842f-0eeff298ed15-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "cinder-7214eab9-5471-4f8f-842f-0eeff298ed15-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Acquiring lock "cinder-quobyte-7214eab9-5471-4f8f-842f-0eeff298ed15" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "cinder-quobyte-7214eab9-5471-4f8f-842f-0eeff298ed15" acquired by "delete_volume" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:27 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e764105d-5cd9-4dfe-82e7-7e1389f0bfc0]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:27 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb" returned: 0 in 1.156s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:27 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb Jun 23 20:22:27 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:27 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 Jun 23 20:22:27 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:28 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15" returned: 0 in 1.274s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:28 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15 Jun 23 20:22:28 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:28 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a60deaaa-f74c-48e4-99a5-d7767441d6cb" returned: 0 in 1.265s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-quobyte-a60deaaa-f74c-48e4-99a5-d7767441d6cb" released by "delete_volume" :: held 2.478s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Created reservations ['3cd7e53e-0588-49f7-8724-f9c85f1052d2', '057a4804-8cf7-4446-8c7e-e7ee2cdb77f2', '52c90242-19aa-4297-a666-e33d7c82b38d', '5fcc8069-f198-472c-8ae3-1aa0d3f9a38f'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:29 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:22:29 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:29 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7214eab9-5471-4f8f-842f-0eeff298ed15" returned: 0 in 1.063s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:29 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "cinder-quobyte-7214eab9-5471-4f8f-842f-0eeff298ed15" released by "delete_volume" :: held 2.451s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:29 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "cinder-6048ebe3-7e0c-4eda-b959-0b65bc349dc1-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:29 devstack cinder-volume[93739]: WARNING cinder.quota [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:22:29 devstack cinder-volume[93739]: WARNING cinder.quota [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:22:29 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-6048ebe3-7e0c-4eda-b959-0b65bc349dc1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:29 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Created reservations ['df846b0a-8175-41c7-a381-231c3e440fc6', 'e7e1f9c4-f069-4a58-a78f-346255435aa3', '89714498-d5a1-45ec-b094-6ca85b07173b', 'f7ffab00-6ab7-4a20-b819-d6615ba66ef0'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:22:29 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "cinder-quobyte-6048ebe3-7e0c-4eda-b959-0b65bc349dc1" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-quobyte-6048ebe3-7e0c-4eda-b959-0b65bc349dc1" acquired by "delete_volume" :: waited 0.068s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955f4ef-03e6-4b75-b528-4edcd091617a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:30 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.124s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:22:30 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Deleted volume successfully. Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f281f66d-6066-40ee-bef7-275ea62b61ef tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-a60deaaa-f74c-48e4-99a5-d7767441d6cb-delete_volume" released by "delete_volume" :: held 4.105s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:30 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:22:30 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:30 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 Jun 23 20:22:30 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:31 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.887s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:31 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:22:31 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Deleted volume successfully. Jun 23 20:22:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bc8e48b-4f87-498b-b8f2-ae0813451917 tempest-VolumeRetypeWithoutMigrationTest-1556395059 None] Lock "cinder-7214eab9-5471-4f8f-842f-0eeff298ed15-delete_volume" released by "delete_volume" :: held 3.949s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:31 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1" returned: 0 in 1.254s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:31 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1 Jun 23 20:22:31 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:31 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Flow 'volume_create_manager' (3c264b60-7a25-4c3b-8d60-9682917fca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ca87e0-29e3-447b-bd66-030034ec932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ca87e0-29e3-447b-bd66-030034ec932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1290629594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0588b74d-964f-4fc7-9590-d50b1c432774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3821f62f7649ada27bb46afe6989ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:32Z,use_quota=True,user_id='47d7fc764ceb4cbd9b6ad84c9b6423f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75dd1c9d-7f41-4ad9-b9a9-9ee471afb911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75dd1c9d-7f41-4ad9-b9a9-9ee471afb911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33315778-bf76-46f1-a0ba-abd2611670c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33315778-bf76-46f1-a0ba-abd2611670c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0588b74d-964f-4fc7-9590-d50b1c432774', 'volume_name': 'volume-0588b74d-964f-4fc7-9590-d50b1c432774', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cf8227-d03e-497f-89ed-962ddb02dd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cf8227-d03e-497f-89ed-962ddb02dd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8de1de2-8238-4fc1-bd60-51566aafbf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:32 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Volume 0588b74d-964f-4fc7-9590-d50b1c432774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0588b74d-964f-4fc7-9590-d50b1c432774', 'volume_size': 1} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1290629594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0588b74d-964f-4fc7-9590-d50b1c432774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3821f62f7649ada27bb46afe6989ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:32Z,use_quota=True,user_id='47d7fc764ceb4cbd9b6ad84c9b6423f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Creating volume 0588b74d-964f-4fc7-9590-d50b1c432774 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:32 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:32 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 1073741824 Jun 23 20:22:32 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:32 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6048ebe3-7e0c-4eda-b959-0b65bc349dc1" returned: 0 in 1.131s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-quobyte-6048ebe3-7e0c-4eda-b959-0b65bc349dc1" released by "delete_volume" :: held 2.449s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Created reservations ['f5f804d2-c6e5-43d4-a711-a6a1d0de49f7', '4a2f5c0c-0c8f-49d3-bbaf-899087aa0a9f', '073cf2cc-97a2-48cf-b935-c1ab1b6331aa', 'e7213254-8127-4fc0-a9df-885be6c8af40'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:32 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:22:32 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:33 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 1073741824" returned: 0 in 1.234s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:33 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 Jun 23 20:22:33 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.985s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:33 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:22:33 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Deleted volume successfully. Jun 23 20:22:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f1ff7635-54ec-41d0-aca4-4261d5249dba tempest-VolumesListTestJSON-1299322144 None] Lock "cinder-6048ebe3-7e0c-4eda-b959-0b65bc349dc1-delete_volume" released by "delete_volume" :: held 3.816s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:22:34 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774" returned: 0 in 0.911s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8de1de2-8238-4fc1-bd60-51566aafbf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0588b74d-964f-4fc7-9590-d50b1c432774', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426333d1-aeb2-4d7e-88c9-9500766b76a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Volume volume-0588b74d-964f-4fc7-9590-d50b1c432774 (0588b74d-964f-4fc7-9590-d50b1c432774): created successfully Jun 23 20:22:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426333d1-aeb2-4d7e-88c9-9500766b76a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Flow 'volume_create_manager' (3c264b60-7a25-4c3b-8d60-9682917fca4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3cd988b2-acb1-44df-bf35-aa941e4839db tempest-AttachVolumeNegativeTest-938637596 None] Created volume successfully. Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Flow 'volume_create_manager' (2c85202f-aa89-4ad2-af52-a4a759561fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036174c3-897d-4dd0-94b3-78183c0e88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036174c3-897d-4dd0-94b3-78183c0e88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1059404298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d44f21-1553-4d2b-975b-e227e728d8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7694130be89745958f928406eda079b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:37Z,use_quota=True,user_id='eabdd1b5a7504e1d92e93b20032f4c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876c1525-1d3d-4875-924c-75b11a04fece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876c1525-1d3d-4875-924c-75b11a04fece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef9ffea-67d1-4886-a766-3f1cca2ae873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef9ffea-67d1-4886-a766-3f1cca2ae873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d44f21-1553-4d2b-975b-e227e728d8be', 'volume_name': 'volume-f4d44f21-1553-4d2b-975b-e227e728d8be', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3ddddb-54cb-4454-aa04-6756c8cebfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3ddddb-54cb-4454-aa04-6756c8cebfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0094c5f-3bec-444e-8e76-eb724cfd92ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Volume f4d44f21-1553-4d2b-975b-e227e728d8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d44f21-1553-4d2b-975b-e227e728d8be', 'volume_size': 1} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1059404298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d44f21-1553-4d2b-975b-e227e728d8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7694130be89745958f928406eda079b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:22:37Z,use_quota=True,user_id='eabdd1b5a7504e1d92e93b20032f4c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Creating volume f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:22:37 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:22:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:37 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be 1073741824 Jun 23 20:22:37 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:38 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be 1073741824" returned: 0 in 0.996s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:38 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be Jun 23 20:22:38 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-9ab054ad-79e8-4307-85b5-41263cd787e0 req-5ef9502f-4bbe-4e89-b49b-6bb8c08b32ac tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:39 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be" returned: 0 in 0.681s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-9ab054ad-79e8-4307-85b5-41263cd787e0 req-5ef9502f-4bbe-4e89-b49b-6bb8c08b32ac tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.643s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0094c5f-3bec-444e-8e76-eb724cfd92ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d44f21-1553-4d2b-975b-e227e728d8be', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee3daf6-ed90-4bce-ba25-47963c784f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4055be-9cc9-45c1-aaf4-985de05e4505]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-9ab054ad-79e8-4307-85b5-41263cd787e0 req-5ef9502f-4bbe-4e89-b49b-6bb8c08b32ac tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:39 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Volume volume-f4d44f21-1553-4d2b-975b-e227e728d8be (f4d44f21-1553-4d2b-975b-e227e728d8be): created successfully Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee3daf6-ed90-4bce-ba25-47963c784f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Flow 'volume_create_manager' (2c85202f-aa89-4ad2-af52-a4a759561fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:22:39 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4b40f398-3869-4114-8208-8484b8f85e12 tempest-VolumesSnapshotListTestJSON-436814926 None] Created volume successfully. Jun 23 20:22:39 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 Jun 23 20:22:39 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:40 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-9ab054ad-79e8-4307-85b5-41263cd787e0 req-5ef9502f-4bbe-4e89-b49b-6bb8c08b32ac tempest-AttachVolumeNegativeTest-938637596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774" returned: 0 in 0.898s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-9ab054ad-79e8-4307-85b5-41263cd787e0 req-5ef9502f-4bbe-4e89-b49b-6bb8c08b32ac tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.924s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.443s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Creating offline snapshot 4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 of volume f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:22:40 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0848e8ff-3d3e-4a86-9a86-b85fee096e93]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-9ab054ad-79e8-4307-85b5-41263cd787e0 req-5ef9502f-4bbe-4e89-b49b-6bb8c08b32ac tempest-AttachVolumeNegativeTest-938637596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-0588b74d-964f-4fc7-9590-d50b1c432774', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1befc9a5-1a7c-4d84-97de-ce7e3189b65a', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:22:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-9ab054ad-79e8-4307-85b5-41263cd787e0 req-5ef9502f-4bbe-4e89-b49b-6bb8c08b32ac tempest-AttachVolumeNegativeTest-938637596 None] attachment_update completed successfully. Jun 23 20:22:40 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be Jun 23 20:22:40 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:41 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be" returned: 0 in 0.858s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:41 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 1G Jun 23 20:22:41 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:42 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 1G" returned: 0 in 0.983s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:42 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 Jun 23 20:22:42 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:42 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" returned: 0 in 0.757s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:42 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 is being set with open permissions: ugo+rw Jun 23 20:22:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:42 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 Jun 23 20:22:42 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:43 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" returned: 0 in 0.717s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:43 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.info Jun 23 20:22:43 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:44 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.info" returned: 0 in 0.770s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:44 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.info is being set with open permissions: ugo+rw Jun 23 20:22:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:44 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.info Jun 23 20:22:44 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:45 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.info" returned: 0 in 0.862s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.078s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:45 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-26013433-6afc-4c8a-a763-5ce0aedc9ba2 tempest-VolumesSnapshotListTestJSON-436814926 None] Create snapshot completed successfully Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Creating offline snapshot d52a6ff0-709a-4b37-ac87-5e3e89686efe of volume f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ea188-f02e-4a81-93d6-cbcdc4b2594e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:46 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 Jun 23 20:22:46 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:46 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:22:46 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:47 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" returned: 0 in 1.153s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d44f21-1553-4d2b-975b-e227e728d8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:22:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:47 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.956s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:22:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:22:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:22:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:22:47 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe 1G Jun 23 20:22:47 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:48 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe 1G" returned: 0 in 1.021s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:48 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe Jun 23 20:22:48 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:49 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe" returned: 0 in 0.891s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:49 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe is being set with open permissions: ugo+rw Jun 23 20:22:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:49 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe Jun 23 20:22:49 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:50 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe" returned: 0 in 0.855s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.058s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b72000a5-0624-4058-a61e-3155916f6734 tempest-VolumesSnapshotListTestJSON-436814926 None] Create snapshot completed successfully Jun 23 20:22:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Creating offline snapshot 46691c7c-0ec4-4de2-ac9b-941addc7651d of volume f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:22:51 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23480bf-3ce8-4b53-8ca3-b02801f61160]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:51 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe Jun 23 20:22:51 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:52 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe" returned: 0 in 1.163s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d44f21-1553-4d2b-975b-e227e728d8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:22:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:52 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d 1G Jun 23 20:22:52 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:53 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d 1G" returned: 0 in 1.189s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:53 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d Jun 23 20:22:53 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-1ad4aefa-28a3-44c2-b5bd-1cbbaa351e63 req-77bc7af7-e9fa-45f3-aa73-4b3e7f523873 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:22:54 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d" returned: 0 in 0.885s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:54 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d is being set with open permissions: ugo+rw Jun 23 20:22:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:54 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d Jun 23 20:22:54 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:54 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d" returned: 0 in 0.727s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.107s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-1ad4aefa-28a3-44c2-b5bd-1cbbaa351e63 req-77bc7af7-e9fa-45f3-aa73-4b3e7f523873 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.846s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:22:55 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62028a7-1b68-4b65-896f-9e5eefa8cf51]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-1ad4aefa-28a3-44c2-b5bd-1cbbaa351e63 req-77bc7af7-e9fa-45f3-aa73-4b3e7f523873 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:55 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-dcb4e82c-6a7a-4af8-9157-bb331599140b tempest-VolumesSnapshotListTestJSON-436814926 None] Create snapshot completed successfully Jun 23 20:22:55 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 Jun 23 20:22:55 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:55 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-1ad4aefa-28a3-44c2-b5bd-1cbbaa351e63 req-77bc7af7-e9fa-45f3-aa73-4b3e7f523873 tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6" returned: 0 in 0.911s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-1ad4aefa-28a3-44c2-b5bd-1cbbaa351e63 req-77bc7af7-e9fa-45f3-aa73-4b3e7f523873 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.953s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:22:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-1ad4aefa-28a3-44c2-b5bd-1cbbaa351e63 req-77bc7af7-e9fa-45f3-aa73-4b3e7f523873 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-767ab74b-238d-4a13-afe3-aed97e60cbd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78871861-a936-48a7-8b01-ddb4732aad34', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:22:56 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-1ad4aefa-28a3-44c2-b5bd-1cbbaa351e63 req-77bc7af7-e9fa-45f3-aa73-4b3e7f523873 tempest-TestServerVolumeAttachmentScenario-2034216832 None] attachment_update completed successfully. Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-46691c7c-0ec4-4de2-ac9b-941addc7651d-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-46691c7c-0ec4-4de2-ac9b-941addc7651d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-quobyte-46691c7c-0ec4-4de2-ac9b-941addc7651d" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-46691c7c-0ec4-4de2-ac9b-941addc7651d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Deleting offline snapshot 46691c7c-0ec4-4de2-ac9b-941addc7651d of volume f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] snapshot_file for this snap is: volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bd076d-b7ef-4dd6-b11c-a4cea910220b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:57 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d Jun 23 20:22:57 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:58 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d" returned: 0 in 1.028s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d44f21-1553-4d2b-975b-e227e728d8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:22:58 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b765e8-9ab8-4122-aeca-29965142d0a5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:22:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:58 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe Jun 23 20:22:58 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:22:59 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jun 23 20:22:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe" returned: 0 in 1.122s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:22:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d44f21-1553-4d2b-975b-e227e728d8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:22:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:22:59 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d Jun 23 20:22:59 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:00 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d" returned: 0 in 1.014s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:00 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d Jun 23 20:23:00 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:01 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.46691c7c-0ec4-4de2-ac9b-941addc7651d" returned: 0 in 1.059s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-46691c7c-0ec4-4de2-ac9b-941addc7651d" released by "_delete_snapshot" :: held 4.388s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" released by "delete_snapshot" :: held 4.419s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:01 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Created reservations ['b8183ef3-3613-48c4-ab42-869acbea196d', 'f4f5353a-7183-474d-b985-c9115caf4a93', 'efa563d2-0168-4aa8-b785-04d6462add0b', '6a540838-6d96-4eda-8adf-7a5af929da48'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:23:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Delete snapshot completed successfully. Jun 23 20:23:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-83a2ca44-c263-4352-b2e6-b806cb2832b0 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-46691c7c-0ec4-4de2-ac9b-941addc7651d-delete_snapshot" released by "delete_snapshot" :: held 4.635s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-d52a6ff0-709a-4b37-ac87-5e3e89686efe-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-d52a6ff0-709a-4b37-ac87-5e3e89686efe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-quobyte-d52a6ff0-709a-4b37-ac87-5e3e89686efe" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-d52a6ff0-709a-4b37-ac87-5e3e89686efe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Deleting offline snapshot d52a6ff0-709a-4b37-ac87-5e3e89686efe of volume f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] snapshot_file for this snap is: volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5378e25-8318-4b29-8380-62461c6913e6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:03 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe Jun 23 20:23:03 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:03 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe" returned: 0 in 0.991s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d44f21-1553-4d2b-975b-e227e728d8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:23:03 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[367f48f8-c5f7-4264-977b-46c6d3ab8640]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:04 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 Jun 23 20:23:04 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:04 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" returned: 0 in 0.981s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d44f21-1553-4d2b-975b-e227e728d8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:23:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:04 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe Jun 23 20:23:04 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:05 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe" returned: 0 in 0.807s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:05 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe Jun 23 20:23:05 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:06 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.d52a6ff0-709a-4b37-ac87-5e3e89686efe" returned: 0 in 0.809s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-d52a6ff0-709a-4b37-ac87-5e3e89686efe" released by "_delete_snapshot" :: held 3.727s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" released by "delete_snapshot" :: held 3.759s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=73,cinder:INSERT=17,cinder:UPDATE=74,cinder:DELETE=7 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=84,cinder:DELETE=9,cinder:INSERT=16,cinder:SELECT=68 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Created reservations ['72b4bcfb-980d-454a-a647-fb8077d3e18a', 'c90fc9e4-ebb9-43e4-ba90-798a8247e31e', '2e852958-aa60-4cc6-aa28-9108a7b5bfaf', '5f0c7e73-0ce6-4688-abe5-9ebad31a040b'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:23:06 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Delete snapshot completed successfully. Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-3ed113dc-25de-4462-8ed1-389a549da3a7 req-296ff271-f47d-4552-93b6-e82281669ef3 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-3ed113dc-25de-4462-8ed1-389a549da3a7 req-296ff271-f47d-4552-93b6-e82281669ef3 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0c10fed-a1c5-4356-a7b7-38bfb54d0525 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-d52a6ff0-709a-4b37-ac87-5e3e89686efe-delete_snapshot" released by "delete_snapshot" :: held 3.989s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[787254df-8526-4c3f-bf89-08707bd26d14]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-3ed113dc-25de-4462-8ed1-389a549da3a7 req-296ff271-f47d-4552-93b6-e82281669ef3 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:06 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf Jun 23 20:23:06 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-quobyte-4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Deleting offline snapshot 4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 of volume f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] snapshot_file for this snap is: volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6721235-8205-46f8-8a5f-a1ad6a53ee4f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:07 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 Jun 23 20:23:07 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:08 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-3ed113dc-25de-4462-8ed1-389a549da3a7 req-296ff271-f47d-4552-93b6-e82281669ef3 tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf" returned: 0 in 1.520s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-3ed113dc-25de-4462-8ed1-389a549da3a7 req-296ff271-f47d-4552-93b6-e82281669ef3 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.545s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-3ed113dc-25de-4462-8ed1-389a549da3a7 req-296ff271-f47d-4552-93b6-e82281669ef3 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-6cef7f2d-901b-490e-b388-771dc83d24cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a51006d-c673-49f9-bbf4-5585bea5338d', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:23:08 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" returned: 0 in 1.197s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d44f21-1553-4d2b-975b-e227e728d8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:23:08 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d317d24a-9309-446e-9e04-b7164ac631b1]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-3ed113dc-25de-4462-8ed1-389a549da3a7 req-296ff271-f47d-4552-93b6-e82281669ef3 tempest-TestServerVolumeAttachmentScenario-2034216832 None] attachment_update completed successfully. Jun 23 20:23:08 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be Jun 23 20:23:08 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:09 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be" returned: 0 in 0.949s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:09 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 Jun 23 20:23:09 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:10 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" returned: 0 in 1.073s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:10 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3 Jun 23 20:23:10 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:11 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be.4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" returned: 0 in 0.853s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3" released by "_delete_snapshot" :: held 4.260s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" released by "delete_snapshot" :: held 4.342s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:11 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Created reservations ['ed53e9e1-b399-4876-94af-808d0373cc6f', '9a2a3078-cbd0-46a1-973f-0944d213a06e', 'dfef7400-439d-4b48-903a-0544d685f183', '58da4f1f-8e18-4b6a-8c11-da09c99acca0'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:23:11 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Delete snapshot completed successfully. Jun 23 20:23:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e67eb94-379d-4c36-8147-bf713ad2beae tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-4ac2c1aa-6a7a-48cb-bf53-05a386c7cba3-delete_snapshot" released by "delete_snapshot" :: held 4.570s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-f4d44f21-1553-4d2b-975b-e227e728d8be-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-f4d44f21-1553-4d2b-975b-e227e728d8be-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:12 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e52586-39bc-456e-8aa6-e9f1e12c1318]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:13 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be Jun 23 20:23:13 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:14 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be" returned: 0 in 1.645s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:14 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be Jun 23 20:23:14 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:15 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f4d44f21-1553-4d2b-975b-e227e728d8be" returned: 0 in 0.722s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-quobyte-f4d44f21-1553-4d2b-975b-e227e728d8be" released by "delete_volume" :: held 2.452s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Created reservations ['bda4f8fe-7abe-4224-b451-d9482816bf4a', '02bbbf4e-d397-4e64-be4c-ef7e4ad1abac', 'eaeeac42-46b9-4f2f-8732-b1cd44657ebf', 'ca02e005-35ad-4b4a-8999-c3810d5685ac'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:15 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:23:15 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-9118db6c-cdfa-4f77-ac05-fd378d09b31f req-3ec5920a-28da-4e65-b846-faeb15405214 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Terminate volume connection completed successfully. Jun 23 20:23:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-9118db6c-cdfa-4f77-ac05-fd378d09b31f req-3ec5920a-28da-4e65-b846-faeb15405214 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Deleting attachment 7a51006d-c673-49f9-bbf4-5585bea5338d. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:23:16 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.811s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:16 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:23:16 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Deleted volume successfully. Jun 23 20:23:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7e6a9025-d4a1-4997-a831-20f76c602292 tempest-VolumesSnapshotListTestJSON-436814926 None] Lock "cinder-f4d44f21-1553-4d2b-975b-e227e728d8be-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:19 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-34e3ade9-5583-4cb4-b4e3-cadba9a2ac6d req-a9770cae-0f2f-44d2-9c35-2eab96f410a6 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Terminate volume connection completed successfully. Jun 23 20:23:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-34e3ade9-5583-4cb4-b4e3-cadba9a2ac6d req-a9770cae-0f2f-44d2-9c35-2eab96f410a6 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Deleting attachment 78871861-a936-48a7-8b01-ddb4732aad34. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (dcfced5a-b7d9-486e-98b8-adec41543db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45ee1ef-4b98-4f54-b8b8-b26743af0203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45ee1ef-4b98-4f54-b8b8-b26743af0203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1549355637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe70f57e-3126-43db-a221-ccb8a0e20d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:23:27Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323b71d5-e1fc-4a79-8e57-12fd93aeb449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323b71d5-e1fc-4a79-8e57-12fd93aeb449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a6c899-5c9a-4c00-989a-51a5d5176d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a6c899-5c9a-4c00-989a-51a5d5176d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe70f57e-3126-43db-a221-ccb8a0e20d2c', 'volume_name': 'volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76643d66-ba46-4752-b472-a33467d68ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76643d66-ba46-4752-b472-a33467d68ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a7cfc1-3516-4586-a65b-6155bcddc13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:26 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Volume fe70f57e-3126-43db-a221-ccb8a0e20d2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c', 'volume_size': 1} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1549355637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe70f57e-3126-43db-a221-ccb8a0e20d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:23:27Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Creating volume fe70f57e-3126-43db-a221-ccb8a0e20d2c {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:23:26 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:23:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:26 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c 1073741824 Jun 23 20:23:26 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:28 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c 1073741824" returned: 0 in 1.526s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:28 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c Jun 23 20:23:28 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:29 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c" returned: 0 in 1.098s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] <== create_volume: return (2721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:23:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.726s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a7cfc1-3516-4586-a65b-6155bcddc13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8753588-8eb4-421b-97aa-3727e7ac4f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:29 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Volume volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c (fe70f57e-3126-43db-a221-ccb8a0e20d2c): created successfully Jun 23 20:23:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8753588-8eb4-421b-97aa-3727e7ac4f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (dcfced5a-b7d9-486e-98b8-adec41543db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:23:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-980ad169-0b0d-4a9b-aaec-23af7ea2a311 tempest-VolumesActionsTest-1373925388 None] Created volume successfully. Jun 23 20:23:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c7aff704-29cc-4a39-8115-5ad7401b902c tempest-VolumesActionsTest-1373925388 None] Acquiring lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c" by "attach_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c7aff704-29cc-4a39-8115-5ad7401b902c tempest-VolumesActionsTest-1373925388 None] Lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c" acquired by "attach_volume" :: waited 0.035s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:30 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c7aff704-29cc-4a39-8115-5ad7401b902c tempest-VolumesActionsTest-1373925388 None] Attaching volume fe70f57e-3126-43db-a221-ccb8a0e20d2c to instance 41fc7eaa-9ae3-4380-b704-aefe66c19e68 at mountpoint /dev/vdb on host None. Jun 23 20:23:30 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c7aff704-29cc-4a39-8115-5ad7401b902c tempest-VolumesActionsTest-1373925388 None] Attach volume completed successfully. Jun 23 20:23:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c7aff704-29cc-4a39-8115-5ad7401b902c tempest-VolumesActionsTest-1373925388 None] Lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c" released by "attach_volume" :: held 0.337s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:31 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8c767724-c7ff-48d6-a872-0ff6b98dbf13 tempest-VolumesActionsTest-164075367 None] Terminate volume connection completed successfully. Jun 23 20:23:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "cinder-6cef7f2d-901b-490e-b388-771dc83d24cf-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "cinder-6cef7f2d-901b-490e-b388-771dc83d24cf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "cinder-quobyte-6cef7f2d-901b-490e-b388-771dc83d24cf" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "cinder-quobyte-6cef7f2d-901b-490e-b388-771dc83d24cf" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:32 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5256e039-26bb-43b9-9b19-4ed923e97864]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:32 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf Jun 23 20:23:32 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c767724-c7ff-48d6-a872-0ff6b98dbf13 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-detach_volume" by "detach_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c767724-c7ff-48d6-a872-0ff6b98dbf13 tempest-VolumesActionsTest-164075367 None] Lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8c767724-c7ff-48d6-a872-0ff6b98dbf13 tempest-VolumesActionsTest-164075367 None] Detaching volume fe70f57e-3126-43db-a221-ccb8a0e20d2c from instance 41fc7eaa-9ae3-4380-b704-aefe66c19e68. Jun 23 20:23:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8c767724-c7ff-48d6-a872-0ff6b98dbf13 tempest-VolumesActionsTest-164075367 None] Detach volume completed successfully. Jun 23 20:23:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8c767724-c7ff-48d6-a872-0ff6b98dbf13 tempest-VolumesActionsTest-164075367 None] Lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5c2ee652-4937-4d0e-a374-ab781434e397 tempest-VolumesActionsTest-1373925388 None] Acquiring lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-detach_volume" by "detach_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5c2ee652-4937-4d0e-a374-ab781434e397 tempest-VolumesActionsTest-1373925388 None] Lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5c2ee652-4937-4d0e-a374-ab781434e397 tempest-VolumesActionsTest-1373925388 None] Volume detach called, but volume not attached. Jun 23 20:23:33 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf" returned: 0 in 1.051s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5c2ee652-4937-4d0e-a374-ab781434e397 tempest-VolumesActionsTest-1373925388 None] Lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:33 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf Jun 23 20:23:33 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Acquiring lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Acquiring lock "cinder-quobyte-fe70f57e-3126-43db-a221-ccb8a0e20d2c" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Lock "cinder-quobyte-fe70f57e-3126-43db-a221-ccb8a0e20d2c" acquired by "delete_volume" :: waited 0.038s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c4f571-20d5-4d42-b192-b1ff9b100046]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:34 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c Jun 23 20:23:34 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:34 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6cef7f2d-901b-490e-b388-771dc83d24cf" returned: 0 in 1.281s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "cinder-quobyte-6cef7f2d-901b-490e-b388-771dc83d24cf" released by "delete_volume" :: held 2.402s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Created reservations ['93d0f0bc-e698-478a-8501-737e93d9cb0c', '480a9ecb-ea75-4199-a41b-b6b3ca7d8ca4', 'fb6cfa06-c71a-4e3c-8334-0ef7d834fb66', '9868b131-c0f6-4fb8-891a-ad95c07c29fe'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:34 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:23:34 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "cinder-767ab74b-238d-4a13-afe3-aed97e60cbd6-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "cinder-767ab74b-238d-4a13-afe3-aed97e60cbd6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "cinder-quobyte-767ab74b-238d-4a13-afe3-aed97e60cbd6" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "cinder-quobyte-767ab74b-238d-4a13-afe3-aed97e60cbd6" acquired by "delete_volume" :: waited 0.031s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f928136-bff7-4fe4-abb9-b6f6e27ad055]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:35 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.995s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:23:35 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 Jun 23 20:23:35 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:35 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Deleted volume successfully. Jun 23 20:23:35 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c" returned: 0 in 1.814s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c56b682d-de3e-44cb-943e-aab16d419b60 tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "cinder-6cef7f2d-901b-490e-b388-771dc83d24cf-delete_volume" released by "delete_volume" :: held 4.050s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:36 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c Jun 23 20:23:36 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:36 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6" returned: 0 in 1.077s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:36 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6 Jun 23 20:23:36 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:36 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-fe70f57e-3126-43db-a221-ccb8a0e20d2c" returned: 0 in 0.914s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Lock "cinder-quobyte-fe70f57e-3126-43db-a221-ccb8a0e20d2c" released by "delete_volume" :: held 2.829s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Created reservations ['bdfe738e-1bf9-4c8e-ab92-6ced9a4450b9', '2e0e382b-2b2b-4d0d-bdf7-89d14530ab12', '8c2450c9-0e18-4c57-8c6e-e9504709d798', '0f6b001a-4d5f-44f7-9101-79c6b1eebbaf'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:37 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:23:37 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:37 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-767ab74b-238d-4a13-afe3-aed97e60cbd6" returned: 0 in 1.035s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "cinder-quobyte-767ab74b-238d-4a13-afe3-aed97e60cbd6" released by "delete_volume" :: held 2.184s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:37 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Created reservations ['a0e845a2-e6aa-423e-9873-e1958e03ef71', '2ca98dbd-4bda-4311-9036-695cb58b0481', 'b7dfe979-0a94-4fbc-a8b4-bcbc9e7f7811', '7a33cdc6-f880-4ddb-8a90-34fcff15608c'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:38 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.874s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:23:38 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Deleted volume successfully. Jun 23 20:23:38 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:23:38 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b3e77621-1f11-48e3-85b7-2126eaa2c60b tempest-VolumesActionsTest-1373925388 None] Lock "cinder-fe70f57e-3126-43db-a221-ccb8a0e20d2c-delete_volume" released by "delete_volume" :: held 4.202s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:39 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.994s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:39 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:23:39 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Deleted volume successfully. Jun 23 20:23:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-50e9a747-af2e-4b33-88da-612faa08f8be tempest-TestServerVolumeAttachmentScenario-2034216832 None] Lock "cinder-767ab74b-238d-4a13-afe3-aed97e60cbd6-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:23:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:46 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:23:46 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:47 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.708s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:23:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:23:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:23:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:INSERT=14,cinder:UPDATE=61,cinder:SELECT=42,cinder:DELETE=3 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (2872f645-62ee-4a09-a9d6-bc62349c694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e4b364-ff2a-4e72-8fd2-269f93f6be09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e4b364-ff2a-4e72-8fd2-269f93f6be09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704766655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:23:48Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c27e56e-6e47-42e9-a62e-ee70314ab80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c27e56e-6e47-42e9-a62e-ee70314ab80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ea04e8-5e7b-40d1-b57c-96f41c241ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ea04e8-5e7b-40d1-b57c-96f41c241ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8', 'volume_name': 'volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc7e6a8-4e47-46b6-994e-6bb972ac05b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc7e6a8-4e47-46b6-994e-6bb972ac05b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7c8903-13fc-4e63-89ee-f4fb9f595597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:48 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Volume 0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8', 'volume_size': 1} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704766655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:23:48Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Creating volume 0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:23:48 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:23:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:48 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 1073741824 Jun 23 20:23:48 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:49 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 1073741824" returned: 0 in 1.177s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:49 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 Jun 23 20:23:49 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:50 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8" returned: 0 in 0.840s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:23:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7c8903-13fc-4e63-89ee-f4fb9f595597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef17c8d-404b-4d30-916b-e68345af1bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:50 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Volume volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 (0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8): created successfully Jun 23 20:23:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef17c8d-404b-4d30-916b-e68345af1bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (2872f645-62ee-4a09-a9d6-bc62349c694e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:23:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-348cd76c-7d98-45c7-ac0f-e0dd1d288234 tempest-VolumesActionsTest-1373925388 None] Created volume successfully. Jun 23 20:23:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Lock "cinder-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:51 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-725d056b-f526-4278-843b-a16fecce9464 req-3eefe6b3-272b-4e06-b9b9-f971503ba634 tempest-AttachVolumeNegativeTest-938637596 None] Terminate volume connection completed successfully. Jun 23 20:23:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-725d056b-f526-4278-843b-a16fecce9464 req-3eefe6b3-272b-4e06-b9b9-f971503ba634 tempest-AttachVolumeNegativeTest-938637596 None] Deleting attachment 1befc9a5-1a7c-4d84-97de-ce7e3189b65a. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:23:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-quobyte-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Lock "cinder-quobyte-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8" acquired by "delete_volume" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:51 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743b4fc-41ae-4f2b-a824-a27a0869d930]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:51 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 Jun 23 20:23:51 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:52 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8" returned: 0 in 0.888s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:52 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8 Jun 23 20:23:52 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:53 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8" returned: 0 in 0.862s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Lock "cinder-quobyte-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8" released by "delete_volume" :: held 1.803s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Created reservations ['ff2988de-6710-41ab-8106-86a6dc6e6d9a', 'ff6e106f-bf1e-49d4-bd17-0fa2168429ab', 'cc4d9d55-023f-4337-8703-d790ce41d5d4', '6db48483-12d0-44d4-b59d-5457a96c86dd'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:53 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:23:53 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:54 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.027s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:23:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Deleted volume successfully. Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-de52a172-51f1-49c1-9c1d-11c2871aeff5 tempest-VolumesActionsTest-164075367 None] Lock "cinder-0ac5b936-d4e5-46e4-a2f4-3fd47bc395c8-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (6e26b620-6ac8-41a3-89a1-0d1581468912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c660b377-8c15-40ab-b681-ab0b2b06a37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c660b377-8c15-40ab-b681-ab0b2b06a37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-40089948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8a8f07-9550-403d-85f4-7874db873156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:23:55Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b288c852-6d05-42bb-95f5-4db1a5ed429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b288c852-6d05-42bb-95f5-4db1a5ed429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c995a036-60dc-4e4f-a3d8-031d051f83c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c995a036-60dc-4e4f-a3d8-031d051f83c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8a8f07-9550-403d-85f4-7874db873156', 'volume_name': 'volume-da8a8f07-9550-403d-85f4-7874db873156', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1544c6e4-6fb9-444d-be39-27da77c11f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1544c6e4-6fb9-444d-be39-27da77c11f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a755442-209e-4474-a2af-f269ddeb9701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:55 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Volume da8a8f07-9550-403d-85f4-7874db873156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8a8f07-9550-403d-85f4-7874db873156', 'volume_size': 1} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-40089948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8a8f07-9550-403d-85f4-7874db873156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:23:55Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Creating volume da8a8f07-9550-403d-85f4-7874db873156 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:23:55 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:23:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:55 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 1073741824 Jun 23 20:23:55 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:56 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 1073741824" returned: 0 in 1.243s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:56 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 Jun 23 20:23:56 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:57 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156" returned: 0 in 1.045s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:23:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:23:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a755442-209e-4474-a2af-f269ddeb9701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8a8f07-9550-403d-85f4-7874db873156', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4f862b-dab8-4e56-bf9f-0fc1ce7ef470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:23:57 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Volume volume-da8a8f07-9550-403d-85f4-7874db873156 (da8a8f07-9550-403d-85f4-7874db873156): created successfully Jun 23 20:23:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4f862b-dab8-4e56-bf9f-0fc1ce7ef470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:23:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (6e26b620-6ac8-41a3-89a1-0d1581468912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:23:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4ce5f348-c730-4d11-b256-1fd13d0c39aa tempest-VolumesActionsTest-1373925388 None] Created volume successfully. Jun 23 20:23:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-da8a8f07-9550-403d-85f4-7874db873156-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Lock "cinder-da8a8f07-9550-403d-85f4-7874db873156-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-quobyte-da8a8f07-9550-403d-85f4-7874db873156" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:23:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Lock "cinder-quobyte-da8a8f07-9550-403d-85f4-7874db873156" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:23:58 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[da969aaa-1ca7-4929-aab8-e447f9d92eb5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:23:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:58 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 Jun 23 20:23:58 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:23:59 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jun 23 20:23:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156" returned: 0 in 1.135s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:23:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:23:59 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156 Jun 23 20:23:59 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:00 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-da8a8f07-9550-403d-85f4-7874db873156" returned: 0 in 0.729s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Lock "cinder-quobyte-da8a8f07-9550-403d-85f4-7874db873156" released by "delete_volume" :: held 1.935s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Created reservations ['531110e6-da83-47aa-b9a1-2cb90cdc2be3', '7c6b5d7f-1268-4278-a397-c639446bd256', '56017376-b1c7-438f-beef-6b6e6d452f4c', 'ea4ef70a-4081-4d5d-811c-9fe17e4285ff'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:00 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:24:00 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:24:01 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (ee26fae0-0a9d-44b2-ad4e-768064651ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d4a6a4-416a-4d8d-b8b4-09c5b704f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.221s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d4a6a4-416a-4d8d-b8b4-09c5b704f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-28170372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8755bae-1937-4f11-8981-fe0f5d9b2960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:02Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9511c7fd-dccd-469f-b9e7-e2ed0d23a272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9511c7fd-dccd-469f-b9e7-e2ed0d23a272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cdc889-3397-466e-8128-8e7b7dce6ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cdc889-3397-466e-8128-8e7b7dce6ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8755bae-1937-4f11-8981-fe0f5d9b2960', 'volume_name': 'volume-a8755bae-1937-4f11-8981-fe0f5d9b2960', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf50434-686e-45ac-8475-340aa17d5f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf50434-686e-45ac-8475-340aa17d5f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80f5db-e0eb-4a25-b194-520a1320cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:01 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Volume a8755bae-1937-4f11-8981-fe0f5d9b2960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8755bae-1937-4f11-8981-fe0f5d9b2960', 'volume_size': 1} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-28170372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8755bae-1937-4f11-8981-fe0f5d9b2960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:02Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Creating volume a8755bae-1937-4f11-8981-fe0f5d9b2960 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:24:01 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Deleted volume successfully. Jun 23 20:24:01 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 1073741824 Jun 23 20:24:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3605ae95-e9c4-473a-888c-dee32964d285 tempest-VolumesActionsTest-164075367 None] Lock "cinder-da8a8f07-9550-403d-85f4-7874db873156-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:01 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:03 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 1073741824" returned: 0 in 1.412s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:03 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 Jun 23 20:24:03 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:04 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960" returned: 0 in 1.047s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] <== create_volume: return (2520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:24:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.522s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80f5db-e0eb-4a25-b194-520a1320cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8755bae-1937-4f11-8981-fe0f5d9b2960', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdf21bc-0c86-457a-b8de-c87b2ff2f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:04 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Volume volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 (a8755bae-1937-4f11-8981-fe0f5d9b2960): created successfully Jun 23 20:24:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdf21bc-0c86-457a-b8de-c87b2ff2f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (ee26fae0-0a9d-44b2-ad4e-768064651ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:04 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-35d5d46e-2ac9-4d48-aec8-ff8c50d46c7c tempest-VolumesActionsTest-1373925388 None] Created volume successfully. Jun 23 20:24:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-a8755bae-1937-4f11-8981-fe0f5d9b2960-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:24:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Lock "cinder-a8755bae-1937-4f11-8981-fe0f5d9b2960-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:24:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-quobyte-a8755bae-1937-4f11-8981-fe0f5d9b2960" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:24:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Lock "cinder-quobyte-a8755bae-1937-4f11-8981-fe0f5d9b2960" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:24:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62096a7-8a5f-46dd-80cc-9f64088da91a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:05 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 Jun 23 20:24:05 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:06 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960" returned: 0 in 0.928s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:06 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960 Jun 23 20:24:06 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:07 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a8755bae-1937-4f11-8981-fe0f5d9b2960" returned: 0 in 0.846s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Lock "cinder-quobyte-a8755bae-1937-4f11-8981-fe0f5d9b2960" released by "delete_volume" :: held 1.869s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=72,cinder:INSERT=18,cinder:UPDATE=70,cinder:DELETE=4 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Created reservations ['a295471e-d755-44f9-be29-69bc08019fa1', '6f759ad0-8474-4c74-8aa7-80f92f193990', '8d5ad1a1-102c-4368-8096-dd0131e23fa8', '15f06427-a8e8-491e-ba2b-73fcb1edb41c'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:07 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:24:07 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (531a1ade-dbe9-4d5a-b40f-988ac2413c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fa1de8-3c04-412f-b5e6-f51967f50762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fa1de8-3c04-412f-b5e6-f51967f50762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-750762816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed8ec77-869d-481c-aef2-8a34d05e14ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:08Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927b9569-93cf-41d9-897f-12f5ae24afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927b9569-93cf-41d9-897f-12f5ae24afed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dfcbc8-8c83-477e-aeb4-77f7e441e3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dfcbc8-8c83-477e-aeb4-77f7e441e3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed8ec77-869d-481c-aef2-8a34d05e14ec', 'volume_name': 'volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3060110c-994c-46be-8874-54f22496734c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3060110c-994c-46be-8874-54f22496734c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71546738-57fd-47d5-8d2b-b85b51ce5c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:08 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Volume 3ed8ec77-869d-481c-aef2-8a34d05e14ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec', 'volume_size': 1} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-750762816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed8ec77-869d-481c-aef2-8a34d05e14ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:08Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Creating volume 3ed8ec77-869d-481c-aef2-8a34d05e14ec {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:24:08 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:08 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec 1073741824 Jun 23 20:24:08 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:08 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.171s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:24:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Deleted volume successfully. Jun 23 20:24:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-273b2154-4814-4c3b-a567-dd033e112f32 tempest-VolumesActionsTest-164075367 None] Lock "cinder-a8755bae-1937-4f11-8981-fe0f5d9b2960-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:09 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec 1073741824" returned: 0 in 1.225s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:09 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec Jun 23 20:24:09 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:10 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec" returned: 0 in 0.821s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:24:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71546738-57fd-47d5-8d2b-b85b51ce5c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b2fc0b-5f1a-40bd-8ef0-aa2b6e10a9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:10 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Volume volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec (3ed8ec77-869d-481c-aef2-8a34d05e14ec): created successfully Jun 23 20:24:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b2fc0b-5f1a-40bd-8ef0-aa2b6e10a9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (531a1ade-dbe9-4d5a-b40f-988ac2413c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-18e3f9e7-bbca-437b-8b43-95f7213d7bfb tempest-VolumesActionsTest-1373925388 None] Created volume successfully. Jun 23 20:24:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-3ed8ec77-869d-481c-aef2-8a34d05e14ec-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:24:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Lock "cinder-3ed8ec77-869d-481c-aef2-8a34d05e14ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:24:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Acquiring lock "cinder-quobyte-3ed8ec77-869d-481c-aef2-8a34d05e14ec" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:24:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Lock "cinder-quobyte-3ed8ec77-869d-481c-aef2-8a34d05e14ec" acquired by "delete_volume" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:24:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17b90b7-7622-4898-a996-bdbd06cf674b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:11 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec Jun 23 20:24:11 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:12 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec" returned: 0 in 0.868s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:12 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec Jun 23 20:24:12 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:13 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3ed8ec77-869d-481c-aef2-8a34d05e14ec" returned: 0 in 0.920s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Lock "cinder-quobyte-3ed8ec77-869d-481c-aef2-8a34d05e14ec" released by "delete_volume" :: held 1.848s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Created reservations ['463ddbbe-854c-464a-88c3-f3905ce96fe0', '52f780de-e6ab-4c16-972a-22340830ce37', '521b18ab-4817-498e-9aa8-52a668f0f7b5', '1a7e2d39-d32f-46c7-93e4-dc8e5a0d3b03'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:13 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:24:13 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (f221d339-fd27-4e4b-82c2-7a6682b475a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d546d8-0f41-4ece-a4ae-8c700c22e9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:15 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.616s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d546d8-0f41-4ece-a4ae-8c700c22e9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-285249752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3faa6dbf-c265-4ec7-9644-465fa916a6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:15Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa6b530-abd9-46ef-8989-a93e2d764cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa6b530-abd9-46ef-8989-a93e2d764cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f8ddf5-130f-4227-a60b-3d8c12590f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f8ddf5-130f-4227-a60b-3d8c12590f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3faa6dbf-c265-4ec7-9644-465fa916a6ac', 'volume_name': 'volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbaee08-94f8-4f0a-89f7-2943c9ef2bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbaee08-94f8-4f0a-89f7-2943c9ef2bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ee08ce-8a36-4e7c-a8ef-7740963c3be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Volume 3faa6dbf-c265-4ec7-9644-465fa916a6ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac', 'volume_size': 1} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-285249752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3faa6dbf-c265-4ec7-9644-465fa916a6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c19cef06f145c0817eb899e8969834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:15Z,use_quota=True,user_id='9a84997c5a4a4146b674336cedbd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Creating volume 3faa6dbf-c265-4ec7-9644-465fa916a6ac {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:24:15 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Deleted volume successfully. Jun 23 20:24:15 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac 1073741824 Jun 23 20:24:15 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4b5e6990-710c-44ac-b280-f3a76d49d993 tempest-VolumesActionsTest-164075367 None] Lock "cinder-3ed8ec77-869d-481c-aef2-8a34d05e14ec-delete_volume" released by "delete_volume" :: held 3.983s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:17 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac 1073741824" returned: 0 in 1.473s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:17 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac Jun 23 20:24:17 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:18 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac" returned: 0 in 1.287s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] <== create_volume: return (2828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:24:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.836s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ee08ce-8a36-4e7c-a8ef-7740963c3be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae7fd24-4804-4828-9004-720cc3681802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:18 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Volume volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac (3faa6dbf-c265-4ec7-9644-465fa916a6ac): created successfully Jun 23 20:24:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae7fd24-4804-4828-9004-720cc3681802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Flow 'volume_create_manager' (f221d339-fd27-4e4b-82c2-7a6682b475a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-43a7189b-83d8-4df8-94ea-690d49fbcb2a tempest-VolumesActionsTest-1373925388 None] Created volume successfully. Jun 23 20:24:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Acquiring lock "cinder-3faa6dbf-c265-4ec7-9644-465fa916a6ac-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:24:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Lock "cinder-3faa6dbf-c265-4ec7-9644-465fa916a6ac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:24:20 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Acquiring lock "cinder-quobyte-3faa6dbf-c265-4ec7-9644-465fa916a6ac" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:24:20 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Lock "cinder-quobyte-3faa6dbf-c265-4ec7-9644-465fa916a6ac" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:24:20 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90337db-746a-43a9-9790-fc5d8c1f6c67]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:20 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac Jun 23 20:24:20 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:21 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac" returned: 0 in 1.330s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:21 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac Jun 23 20:24:21 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:22 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3faa6dbf-c265-4ec7-9644-465fa916a6ac" returned: 0 in 1.097s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Lock "cinder-quobyte-3faa6dbf-c265-4ec7-9644-465fa916a6ac" released by "delete_volume" :: held 2.495s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Created reservations ['5420f72e-1993-4538-b98e-0014442348bd', '6f067ade-26d5-4eeb-8559-ad17b0017f0e', '9aa4ffe6-e473-4440-9b6a-83c1297583c6', '97a528a3-f301-4064-9fa9-f01fae9c1685'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:22 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:24:22 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Flow 'volume_create_manager' (747ab52f-f7ce-4385-8455-316f4dc6ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6b422a-1e87-4cc4-bdb7-efc5efe9c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6b422a-1e87-4cc4-bdb7-efc5efe9c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-225010184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1257213-4eb9-4182-ab0b-dd162de5cc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8137304b808648668ec59e8a311a3fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:24Z,use_quota=True,user_id='ff18c3512f414722b8a85c7c5ce74e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394208b6-e80b-4209-8405-9b72156f1f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394208b6-e80b-4209-8405-9b72156f1f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052c56fc-0126-48eb-a2d4-428243c88f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052c56fc-0126-48eb-a2d4-428243c88f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1257213-4eb9-4182-ab0b-dd162de5cc40', 'volume_name': 'volume-c1257213-4eb9-4182-ab0b-dd162de5cc40', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b9c98d-adb6-4881-8085-7bd67e3c2b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b9c98d-adb6-4881-8085-7bd67e3c2b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e57890-7422-45f8-815a-7f5230157530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:24 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Volume c1257213-4eb9-4182-ab0b-dd162de5cc40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1257213-4eb9-4182-ab0b-dd162de5cc40', 'volume_size': 1} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-225010184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1257213-4eb9-4182-ab0b-dd162de5cc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8137304b808648668ec59e8a311a3fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:24Z,use_quota=True,user_id='ff18c3512f414722b8a85c7c5ce74e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Creating volume c1257213-4eb9-4182-ab0b-dd162de5cc40 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:24:24 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:24 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 1073741824 Jun 23 20:24:24 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.905s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:24 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:24:24 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Deleted volume successfully. Jun 23 20:24:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b0930066-20b2-425d-a234-3ff825603ca5 tempest-VolumesActionsTest-1373925388 None] Lock "cinder-3faa6dbf-c265-4ec7-9644-465fa916a6ac-delete_volume" released by "delete_volume" :: held 4.772s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:25 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 1073741824" returned: 0 in 1.261s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:25 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 Jun 23 20:24:25 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:26 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40" returned: 0 in 1.185s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] <== create_volume: return (2502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:24:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.505s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e57890-7422-45f8-815a-7f5230157530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1257213-4eb9-4182-ab0b-dd162de5cc40', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3220db-7c4b-4c12-9ec9-1cb31d4cbdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:26 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Volume volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 (c1257213-4eb9-4182-ab0b-dd162de5cc40): created successfully Jun 23 20:24:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3220db-7c4b-4c12-9ec9-1cb31d4cbdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Flow 'volume_create_manager' (747ab52f-f7ce-4385-8455-316f4dc6ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:27 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bbf3d510-e736-45c9-a02e-172d655a4e33 tempest-TestMinimumBasicScenario-1383564266 None] Created volume successfully. Jun 23 20:24:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-38f3a406-3cb1-431b-bfad-de3997afcb9b req-fd860482-9014-4091-89a0-5cbced6144bb tempest-TestMinimumBasicScenario-1383564266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-38f3a406-3cb1-431b-bfad-de3997afcb9b req-fd860482-9014-4091-89a0-5cbced6144bb tempest-TestMinimumBasicScenario-1383564266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[57860567-c4e2-488d-b338-26cf8abe5756]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-38f3a406-3cb1-431b-bfad-de3997afcb9b req-fd860482-9014-4091-89a0-5cbced6144bb tempest-TestMinimumBasicScenario-1383564266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:31 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 Jun 23 20:24:31 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:32 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-38f3a406-3cb1-431b-bfad-de3997afcb9b req-fd860482-9014-4091-89a0-5cbced6144bb tempest-TestMinimumBasicScenario-1383564266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40" returned: 0 in 0.966s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-38f3a406-3cb1-431b-bfad-de3997afcb9b req-fd860482-9014-4091-89a0-5cbced6144bb tempest-TestMinimumBasicScenario-1383564266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-38f3a406-3cb1-431b-bfad-de3997afcb9b req-fd860482-9014-4091-89a0-5cbced6144bb tempest-TestMinimumBasicScenario-1383564266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-c1257213-4eb9-4182-ab0b-dd162de5cc40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b56c53d-bd81-4b5f-93f0-55f044924f99', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:24:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-38f3a406-3cb1-431b-bfad-de3997afcb9b req-fd860482-9014-4091-89a0-5cbced6144bb tempest-TestMinimumBasicScenario-1383564266 None] attachment_update completed successfully. Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Flow 'volume_create_manager' (ff411b8b-c11d-4c7d-8ca6-ad9e354853f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93adc02d-3e7c-4ba1-9e0c-b20735141682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93adc02d-3e7c-4ba1-9e0c-b20735141682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-222375837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74a4656-abe6-40a9-86f3-2a75791b5316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d166b0f92f4c481bb5234002729f98f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:34Z,use_quota=True,user_id='e06b6a3d598148b892cd24ff6d86e58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f593324b-d6ae-4477-b48c-0622f18b8b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f593324b-d6ae-4477-b48c-0622f18b8b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d9b60a-fe22-454f-80de-343c9c13fba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d9b60a-fe22-454f-80de-343c9c13fba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e74a4656-abe6-40a9-86f3-2a75791b5316', 'volume_name': 'volume-e74a4656-abe6-40a9-86f3-2a75791b5316', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b078e7c8-253f-4299-b286-240943dfd963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b078e7c8-253f-4299-b286-240943dfd963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce335002-78be-439b-9931-ea11f0c1d09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:35 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Volume e74a4656-abe6-40a9-86f3-2a75791b5316: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e74a4656-abe6-40a9-86f3-2a75791b5316', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 20:24:35 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Trying to clone e74a4656-abe6-40a9-86f3-2a75791b5316 from image 8123ebb9-f4e0-4d01-974c-3920c780745e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:24:35 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:24:35 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Image download 20.69 MB at 20.69 MB/s Jun 23 20:24:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f094ce-0a63-4860-a524-c1c121a4bae9]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:36 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD Jun 23 20:24:36 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:37 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD" returned: 0 in 1.625s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:37 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Temporary image 8123ebb9-f4e0-4d01-974c-3920c780745e is fetched for user e06b6a3d598148b892cd24ff6d86e58c. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:24:37 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[27095008-1e98-4d0b-b71d-8372ffb255a8]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:37 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD Jun 23 20:24:37 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:39 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD" returned: 0 in 1.591s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-222375837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74a4656-abe6-40a9-86f3-2a75791b5316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d166b0f92f4c481bb5234002729f98f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:34Z,use_quota=True,user_id='e06b6a3d598148b892cd24ff6d86e58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Creating volume e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:24:39 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:24:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:39 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 1073741824 Jun 23 20:24:39 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:40 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 1073741824" returned: 0 in 1.378s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:40 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:24:40 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:41 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 0 in 1.085s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] <== create_volume: return (2539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:24:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.541s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:41 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Attempting download of 8123ebb9-f4e0-4d01-974c-3920c780745e ((None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}])) to volume e74a4656-abe6-40a9-86f3-2a75791b5316. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:24:41 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d068e04-3606-451d-973c-28db1cb74b8e]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_9p83jq5j {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:41 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_9p83jq5j Jun 23 20:24:41 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:42 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_9p83jq5j" returned: 0 in 0.955s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_9p83jq5j {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:42 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_9p83jq5j Jun 23 20:24:42 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:43 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_9p83jq5j" returned: 1 in 1.057s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8123ebb9-f4e0-4d01-974c-3920c780745e_9p83jq5j' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:24:43 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bc1b7f-e9a3-40cd-859f-e980a19fefcb]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:43 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD Jun 23 20:24:43 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Flow 'volume_create_manager' (8c901089-87e8-431d-8276-886f009d0ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e9fc61-1153-4e3e-98fd-271906648d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e9fc61-1153-4e3e-98fd-271906648d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2004844708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca437902-914f-46e1-b806-5a8717f2c98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17183f3e026d47af871b60df6ba3cf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:45Z,use_quota=True,user_id='e495d4997bc047d7838ee053fd7aeb82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97969b3-225a-4d79-9cb3-9994b788214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97969b3-225a-4d79-9cb3-9994b788214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5edd82b-1633-49b3-b168-ca831381350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5edd82b-1633-49b3-b168-ca831381350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca437902-914f-46e1-b806-5a8717f2c98b', 'volume_name': 'volume-ca437902-914f-46e1-b806-5a8717f2c98b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a074909-a147-4f9a-95cf-282024a12f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a074909-a147-4f9a-95cf-282024a12f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074dac53-2b98-4ae8-a4d5-4c8f9ba4353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:44 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Volume ca437902-914f-46e1-b806-5a8717f2c98b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca437902-914f-46e1-b806-5a8717f2c98b', 'volume_size': 1} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2004844708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca437902-914f-46e1-b806-5a8717f2c98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17183f3e026d47af871b60df6ba3cf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:45Z,use_quota=True,user_id='e495d4997bc047d7838ee053fd7aeb82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Creating volume ca437902-914f-46e1-b806-5a8717f2c98b {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:24:44 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:44 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b 1073741824 Jun 23 20:24:44 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:44 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD" returned: 0 in 1.153s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] 8123ebb9-f4e0-4d01-974c-3920c780745e was qcow2, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:24:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:44 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:24:44 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:46 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b 1073741824" returned: 0 in 1.288s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:46 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b Jun 23 20:24:46 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:46 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:24:46 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:47 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b" returned: 0 in 1.184s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074dac53-2b98-4ae8-a4d5-4c8f9ba4353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca437902-914f-46e1-b806-5a8717f2c98b', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d3ae89-0573-4479-ab1e-f54ae5be4216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:47 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Volume volume-ca437902-914f-46e1-b806-5a8717f2c98b (ca437902-914f-46e1-b806-5a8717f2c98b): created successfully Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d3ae89-0573-4479-ab1e-f54ae5be4216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Flow 'volume_create_manager' (8c901089-87e8-431d-8276-886f009d0ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:47 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9c0c6b2b-7253-445c-9f7f-73458a37d0cc tempest-AbsoluteLimitsTests-528157518 None] Created volume successfully. Jun 23 20:24:47 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 0 in 2.748s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8123ebb9-f4e0-4d01-974c-3920c780745e_wtor07tzdevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:24:47 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Converted 112.00 MB image at 40.74 MB/s Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:47 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 1G Jun 23 20:24:47 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:47 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.118s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:24:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Acquiring lock "cinder-ca437902-914f-46e1-b806-5a8717f2c98b-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Lock "cinder-ca437902-914f-46e1-b806-5a8717f2c98b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Acquiring lock "cinder-quobyte-ca437902-914f-46e1-b806-5a8717f2c98b" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Lock "cinder-quobyte-ca437902-914f-46e1-b806-5a8717f2c98b" acquired by "delete_volume" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2356640-3987-4161-bee2-4645c334d1c5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:48 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b Jun 23 20:24:48 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:48 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 1G" returned: 0 in 0.921s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e1c1ad-25f1-4701-bc28-4b8233493f9c]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:48 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:24:48 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:49 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b" returned: 0 in 0.874s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:49 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b Jun 23 20:24:49 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:49 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 0 in 0.902s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:49 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:24:49 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:49 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ca437902-914f-46e1-b806-5a8717f2c98b" returned: 0 in 0.847s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Lock "cinder-quobyte-ca437902-914f-46e1-b806-5a8717f2c98b" released by "delete_volume" :: held 1.773s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=58,cinder:INSERT=15,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Created reservations ['bbfbb826-19b6-40bf-8803-c0ebb5992c3f', '9bcecb62-7479-48ce-a58b-b1439f5a6849', '46e27509-5d70-4b4f-b351-6dd4b7a59e4a', '21ed63bc-1ee3-489f-bf8f-3a404ff6902a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:50 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:24:50 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:50 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 1 in 0.876s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Downloaded image 8123ebb9-f4e0-4d01-974c-3920c780745e ((None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}])) to volume e74a4656-abe6-40a9-86f3-2a75791b5316 successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Temporary image 8123ebb9-f4e0-4d01-974c-3920c780745e for user e06b6a3d598148b892cd24ff6d86e58c is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Marking volume e74a4656-abe6-40a9-86f3-2a75791b5316 as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Copying metadata from image 8123ebb9-f4e0-4d01-974c-3920c780745e to e74a4656-abe6-40a9-86f3-2a75791b5316. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Creating volume glance metadata for volume e74a4656-abe6-40a9-86f3-2a75791b5316 backed by image 8123ebb9-f4e0-4d01-974c-3920c780745e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce335002-78be-439b-9931-ea11f0c1d09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74a4656-abe6-40a9-86f3-2a75791b5316', 'volume_size': 1, 'image_id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8123ebb9-f4e0-4d01-974c-3920c780745e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b42c64e51447492783f72aa097140efa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8123ebb9-f4e0-4d01-974c-3920c780745e', 'created_at': datetime.datetime(2026, 6, 23, 18, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8123ebb9-f4e0-4d01-974c-3920c780745e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7767814d-59d7-432f-94a6-9d17da730b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:50 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Volume volume-e74a4656-abe6-40a9-86f3-2a75791b5316 (e74a4656-abe6-40a9-86f3-2a75791b5316): created successfully Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7767814d-59d7-432f-94a6-9d17da730b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Flow 'volume_create_manager' (ff411b8b-c11d-4c7d-8ca6-ad9e354853f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a6121754-b88f-4584-92c7-60f06c6ec024 tempest-TestShelveInstance-815534228 None] Created volume successfully. Jun 23 20:24:50 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.787s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:24:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Deleted volume successfully. Jun 23 20:24:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2ded8805-c7da-428e-b049-67ec482b32fc tempest-AbsoluteLimitsTests-528157518 None] Lock "cinder-ca437902-914f-46e1-b806-5a8717f2c98b-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:24:54 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:24:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Flow 'volume_create_manager' (d991a99b-8512-4e05-8d5c-4197bdccc3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39759c21-e462-46da-9b7a-729b15287a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39759c21-e462-46da-9b7a-729b15287a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1160472818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168499ab-065b-48b6-b508-9ba20fd02e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6681dfb8258c4390b69a8ed195441f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:55Z,use_quota=True,user_id='b80b8368eb644bcb930ff6d3d74edd6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26dc258-79cd-40e8-bc98-c039b5af47fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26dc258-79cd-40e8-bc98-c039b5af47fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26242d7d-012a-42d1-84dd-f4418ebdd49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26242d7d-012a-42d1-84dd-f4418ebdd49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168499ab-065b-48b6-b508-9ba20fd02e75', 'volume_name': 'volume-168499ab-065b-48b6-b508-9ba20fd02e75', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901f1171-68b4-4b55-b551-60749aa9dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901f1171-68b4-4b55-b551-60749aa9dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7faa7b30-bc68-4fed-b323-ad0f1e68f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:55 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Volume 168499ab-065b-48b6-b508-9ba20fd02e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168499ab-065b-48b6-b508-9ba20fd02e75', 'volume_size': 1} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1160472818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168499ab-065b-48b6-b508-9ba20fd02e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6681dfb8258c4390b69a8ed195441f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:24:55Z,use_quota=True,user_id='b80b8368eb644bcb930ff6d3d74edd6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Creating volume 168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:24:55 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:24:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:55 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 1073741824 Jun 23 20:24:55 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:56 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 1073741824" returned: 0 in 0.999s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:56 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 Jun 23 20:24:56 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:56 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75" returned: 0 in 0.678s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7faa7b30-bc68-4fed-b323-ad0f1e68f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168499ab-065b-48b6-b508-9ba20fd02e75', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006d1d9b-cad6-4c58-a302-5f3a077d0395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:24:56 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Volume volume-168499ab-065b-48b6-b508-9ba20fd02e75 (168499ab-065b-48b6-b508-9ba20fd02e75): created successfully Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006d1d9b-cad6-4c58-a302-5f3a077d0395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:24:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Flow 'volume_create_manager' (d991a99b-8512-4e05-8d5c-4197bdccc3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:24:56 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c631e2a4-0b40-4fb1-9999-17e357b13613 tempest-VolumesDeleteCascade-1166775289 None] Created volume successfully. Jun 23 20:24:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:24:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Creating offline snapshot cdb86048-2515-4065-8f94-b7f9f8c1302d of volume 168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:24:57 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2444ee4-3773-4e97-a1c5-ef74ba416095]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:24:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:57 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 Jun 23 20:24:57 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:58 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75" returned: 0 in 0.874s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:58 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d 1G Jun 23 20:24:58 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:59 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d 1G" returned: 0 in 0.949s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168499ab-065b-48b6-b508-9ba20fd02e75 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:59 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168499ab-065b-48b6-b508-9ba20fd02e75 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d Jun 23 20:24:59 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:24:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:24:59 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jun 23 20:24:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168499ab-065b-48b6-b508-9ba20fd02e75 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d" returned: 0 in 0.778s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:24:59 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d is being set with open permissions: ugo+rw Jun 23 20:24:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:24:59 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d Jun 23 20:24:59 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:25:00 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Flow 'volume_create_manager' (d21cf779-fb2e-4f6d-b545-c6a40208d3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bceed6ad-bcec-41f1-8dcf-d7b099ca8196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d" returned: 0 in 0.801s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bceed6ad-bcec-41f1-8dcf-d7b099ca8196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1874056152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb17fe4a-1ae0-4942-aa16-cde10eba8cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3821f62f7649ada27bb46afe6989ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:25:01Z,use_quota=True,user_id='47d7fc764ceb4cbd9b6ad84c9b6423f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c3a36f-ebae-4e9e-a681-5a9c5e28b334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c3a36f-ebae-4e9e-a681-5a9c5e28b334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d794505-47d6-4adb-af59-2e1759d56463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d794505-47d6-4adb-af59-2e1759d56463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb17fe4a-1ae0-4942-aa16-cde10eba8cd1', 'volume_name': 'volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4415f2b-8744-4124-9ace-299a9210f8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4415f2b-8744-4124-9ace-299a9210f8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a816100f-990e-405c-a894-88636acaf07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:00 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Volume bb17fe4a-1ae0-4942-aa16-cde10eba8cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1', 'volume_size': 1} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:00 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.info Jun 23 20:25:00 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:01 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.info" returned: 0 in 0.690s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:01 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.info is being set with open permissions: ugo+rw Jun 23 20:25:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:01 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.info Jun 23 20:25:01 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:02 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.info" returned: 0 in 0.715s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.959s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.953s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4390bce3-df85-422f-a2d8-e81624f2638a tempest-VolumesDeleteCascade-1166775289 None] Create snapshot completed successfully Jun 23 20:25:02 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5091960-070b-4f78-b113-b08c345ae91d]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:02 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:25:02 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:03 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 0 in 0.781s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:03 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:25:03 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:04 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 1 in 1.100s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.935s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.398s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1874056152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb17fe4a-1ae0-4942-aa16-cde10eba8cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3821f62f7649ada27bb46afe6989ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:25:01Z,use_quota=True,user_id='47d7fc764ceb4cbd9b6ad84c9b6423f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Creating volume bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:25:04 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:04 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 1073741824 Jun 23 20:25:04 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-e74a4656-abe6-40a9-86f3-2a75791b5316', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39777458-a69d-446a-99b7-4e35a6ed7024', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:25:04 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-c7d0b5ad-6ca5-4943-a5ee-030881c89c77 req-14590313-0489-4fa3-b2de-2bda3ca90bd6 tempest-TestShelveInstance-815534228 None] attachment_update completed successfully. Jun 23 20:25:05 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 1073741824" returned: 0 in 1.452s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:05 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 Jun 23 20:25:05 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:06 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1" returned: 0 in 0.928s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] <== create_volume: return (2432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.839s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a816100f-990e-405c-a894-88636acaf07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13e8c16-1ef6-4ed1-b65e-899a253ef793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Creating offline snapshot 0c941443-9e03-459a-ab26-16035d9e1f4a of volume 168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:25:06 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Volume volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 (bb17fe4a-1ae0-4942-aa16-cde10eba8cd1): created successfully Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13e8c16-1ef6-4ed1-b65e-899a253ef793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Flow 'volume_create_manager' (d21cf779-fb2e-4f6d-b545-c6a40208d3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a0485-1fbf-4ba5-8730-2598ed821a74]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:06 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-03978b50-5761-43a5-b850-1964e8ee087c tempest-AttachVolumeNegativeTest-938637596 None] Created volume successfully. Jun 23 20:25:06 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d Jun 23 20:25:06 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:07 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d" returned: 0 in 0.893s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-168499ab-065b-48b6-b508-9ba20fd02e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:25:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:07 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a 1G Jun 23 20:25:07 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:08 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a 1G" returned: 0 in 1.027s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:08 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a Jun 23 20:25:08 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:09 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a" returned: 0 in 0.846s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:09 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a is being set with open permissions: ugo+rw Jun 23 20:25:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:09 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a Jun 23 20:25:09 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:10 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:INSERT=20,cinder:UPDATE=58,cinder:SELECT=52,cinder:DELETE=8 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:25:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c86ee761-db8e-4f18-b408-d03ea7f5765c req-fc749d57-7b76-4fa4-9c2e-0796db3de59a tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:10 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a" returned: 0 in 1.078s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.046s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c86ee761-db8e-4f18-b408-d03ea7f5765c req-fc749d57-7b76-4fa4-9c2e-0796db3de59a tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.296s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8f2ec410-ce60-40ef-955f-1755c243842a tempest-VolumesDeleteCascade-1166775289 None] Create snapshot completed successfully Jun 23 20:25:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d9d7a-ff2e-488f-80de-b21abae24ca7]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c86ee761-db8e-4f18-b408-d03ea7f5765c req-fc749d57-7b76-4fa4-9c2e-0796db3de59a tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:10 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 Jun 23 20:25:10 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-168499ab-065b-48b6-b508-9ba20fd02e75-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-168499ab-065b-48b6-b508-9ba20fd02e75-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Performing cascade delete. {{(pid=93739) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-0c941443-9e03-459a-ab26-16035d9e1f4a-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-0c941443-9e03-459a-ab26-16035d9e1f4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-0c941443-9e03-459a-ab26-16035d9e1f4a" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-0c941443-9e03-459a-ab26-16035d9e1f4a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Deleting offline snapshot 0c941443-9e03-459a-ab26-16035d9e1f4a of volume 168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] snapshot_file for this snap is: volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43c172c-8b58-45ee-ac3c-087d95b7dbc5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:11 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a Jun 23 20:25:11 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:12 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c86ee761-db8e-4f18-b408-d03ea7f5765c req-fc749d57-7b76-4fa4-9c2e-0796db3de59a tempest-AttachVolumeNegativeTest-938637596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1" returned: 0 in 1.521s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c86ee761-db8e-4f18-b408-d03ea7f5765c req-fc749d57-7b76-4fa4-9c2e-0796db3de59a tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.613s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c86ee761-db8e-4f18-b408-d03ea7f5765c req-fc749d57-7b76-4fa4-9c2e-0796db3de59a tempest-AttachVolumeNegativeTest-938637596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a39aaa94-6d51-4724-b807-fea46958ad7f', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:25:12 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-c86ee761-db8e-4f18-b408-d03ea7f5765c req-fc749d57-7b76-4fa4-9c2e-0796db3de59a tempest-AttachVolumeNegativeTest-938637596 None] attachment_update completed successfully. Jun 23 20:25:12 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a" returned: 0 in 1.153s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-168499ab-065b-48b6-b508-9ba20fd02e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:25:12 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[20264279-737a-4947-8231-62fe3703820a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:13 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d Jun 23 20:25:13 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:14 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d" returned: 0 in 1.229s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-168499ab-065b-48b6-b508-9ba20fd02e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:25:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:14 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a Jun 23 20:25:14 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:15 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a" returned: 0 in 1.197s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:15 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a Jun 23 20:25:15 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:16 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.0c941443-9e03-459a-ab26-16035d9e1f4a" returned: 0 in 1.037s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-0c941443-9e03-459a-ab26-16035d9e1f4a" released by "_delete_snapshot" :: held 4.742s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" released by "delete_snapshot" :: held 4.778s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Created reservations ['10b347f7-8379-4215-b397-c6d17eddab62', '27a6f48a-b3da-42a6-9c42-6d60cb094a72', '1651a12b-87cb-4313-892e-f54561a895fa', 'db8ab57b-1bfb-4bf6-9fcf-3977c34bc44a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:25:16 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Delete snapshot completed successfully. Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-0c941443-9e03-459a-ab26-16035d9e1f4a-delete_snapshot" released by "delete_snapshot" :: held 5.004s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-cdb86048-2515-4065-8f94-b7f9f8c1302d-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-cdb86048-2515-4065-8f94-b7f9f8c1302d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-cdb86048-2515-4065-8f94-b7f9f8c1302d" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-cdb86048-2515-4065-8f94-b7f9f8c1302d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Deleting offline snapshot cdb86048-2515-4065-8f94-b7f9f8c1302d of volume 168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] snapshot_file for this snap is: volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d9c0ee-2c95-430f-953b-e5f5490aab78]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:17 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d Jun 23 20:25:17 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:18 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d" returned: 0 in 1.544s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-168499ab-065b-48b6-b508-9ba20fd02e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:25:18 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef25300-b060-407c-81de-85e8363e2964]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:18 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 Jun 23 20:25:18 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:19 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75" returned: 0 in 1.238s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:19 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d Jun 23 20:25:19 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:20 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-d1bb6086-ea62-420a-9a3e-8338558c3907 req-ce2bbcaf-d307-4b4b-8517-c4abc5dcbd80 tempest-AttachVolumeNegativeTest-938637596 None] Terminate volume connection completed successfully. Jun 23 20:25:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-d1bb6086-ea62-420a-9a3e-8338558c3907 req-ce2bbcaf-d307-4b4b-8517-c4abc5dcbd80 tempest-AttachVolumeNegativeTest-938637596 None] Deleting attachment a39aaa94-6d51-4724-b807-fea46958ad7f. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:25:20 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d" returned: 0 in 0.947s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:20 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d Jun 23 20:25:20 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:21 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75.cdb86048-2515-4065-8f94-b7f9f8c1302d" returned: 0 in 0.768s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-cdb86048-2515-4065-8f94-b7f9f8c1302d" released by "_delete_snapshot" :: held 4.678s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" released by "delete_snapshot" :: held 4.713s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Created reservations ['21278fad-2573-4b22-88cb-4077af4a013d', '547f9f9b-df84-4509-8afc-314a9180e723', '435ab5cf-4d02-4054-93bb-7f0cc12f417b', '187c20d2-9638-40ab-af53-7635410e6dc8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:25:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Delete snapshot completed successfully. Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-cdb86048-2515-4065-8f94-b7f9f8c1302d-delete_snapshot" released by "delete_snapshot" :: held 4.896s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Snapshots deleted, issuing volume delete {{(pid=93739) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" acquired by "delete_volume" :: waited 0.013s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc352a2-ba2b-4495-af5c-ed0ccb4a35e9]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:21 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 Jun 23 20:25:21 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:22 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75" returned: 0 in 0.840s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:22 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75 Jun 23 20:25:22 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:23 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-168499ab-065b-48b6-b508-9ba20fd02e75" returned: 0 in 0.767s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-168499ab-065b-48b6-b508-9ba20fd02e75" released by "delete_volume" :: held 1.668s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Created reservations ['e4662ef5-9af5-47fe-b07c-0ae6d7d33b64', 'b5f64d4f-fdb9-467f-b234-207bf9545a2c', 'e78f2145-f055-4e7d-bf21-11e2e81d15ef', '2b21a53e-2209-477f-bff3-8efe3e4f184e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:23 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:25:23 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:24 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.111s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:24 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:25:24 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Deleted volume successfully. Jun 23 20:25:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-abdb6db7-864e-4c9a-a37b-b2da908b5e91 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-168499ab-065b-48b6-b508-9ba20fd02e75-delete_volume" released by "delete_volume" :: held 13.034s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Flow 'volume_create_manager' (0353c2bc-2f10-421e-a77c-7e485c97084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfd1d99-e132-42e6-8c4d-43fb4868b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfd1d99-e132-42e6-8c4d-43fb4868b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-874579531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e061db-19f5-4152-a896-47babcfd0ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6681dfb8258c4390b69a8ed195441f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:25:25Z,use_quota=True,user_id='b80b8368eb644bcb930ff6d3d74edd6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be210f58-3c44-48e4-9e23-7faccb9255a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be210f58-3c44-48e4-9e23-7faccb9255a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3706a94a-5073-4e3d-8726-edff8eb91302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3706a94a-5073-4e3d-8726-edff8eb91302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e061db-19f5-4152-a896-47babcfd0ef3', 'volume_name': 'volume-75e061db-19f5-4152-a896-47babcfd0ef3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf23fc2-813b-49af-8bbc-858154306684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf23fc2-813b-49af-8bbc-858154306684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8634d405-cbd2-40cd-b6e0-d0677d5ccdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:25 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Volume 75e061db-19f5-4152-a896-47babcfd0ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e061db-19f5-4152-a896-47babcfd0ef3', 'volume_size': 1} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-874579531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e061db-19f5-4152-a896-47babcfd0ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6681dfb8258c4390b69a8ed195441f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:25:25Z,use_quota=True,user_id='b80b8368eb644bcb930ff6d3d74edd6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Creating volume 75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:25:25 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:25:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:25 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 1073741824 Jun 23 20:25:25 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:26 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 1073741824" returned: 0 in 0.910s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:26 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 Jun 23 20:25:26 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:27 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3" returned: 0 in 0.823s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:25:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8634d405-cbd2-40cd-b6e0-d0677d5ccdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e061db-19f5-4152-a896-47babcfd0ef3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7471c7-37f3-4841-b140-0f9380322d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:27 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Volume volume-75e061db-19f5-4152-a896-47babcfd0ef3 (75e061db-19f5-4152-a896-47babcfd0ef3): created successfully Jun 23 20:25:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7471c7-37f3-4841-b140-0f9380322d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Flow 'volume_create_manager' (0353c2bc-2f10-421e-a77c-7e485c97084b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:25:27 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c2babefe-3742-424b-8a4c-c63b7d4bf23e tempest-VolumesDeleteCascade-1166775289 None] Created volume successfully. Jun 23 20:25:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Creating offline snapshot 3298f403-3471-4a14-ab51-1b319d3a604f of volume 75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:25:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3c1e5e-ac6e-4537-b737-6fb3b6871747]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:28 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 Jun 23 20:25:28 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:29 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3" returned: 0 in 1.043s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:29 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f 1G Jun 23 20:25:29 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:31 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f 1G" returned: 0 in 1.376s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e061db-19f5-4152-a896-47babcfd0ef3 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:31 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e061db-19f5-4152-a896-47babcfd0ef3 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f Jun 23 20:25:31 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:31 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e061db-19f5-4152-a896-47babcfd0ef3 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f" returned: 0 in 0.940s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:31 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f is being set with open permissions: ugo+rw Jun 23 20:25:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:31 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f Jun 23 20:25:32 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:32 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f" returned: 0 in 0.756s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:32 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.info Jun 23 20:25:32 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-36f50e64-eac2-4a8b-876c-0f2640673aea req-a72c0299-194b-4efb-a192-fd31c93d57bb tempest-TestMinimumBasicScenario-1383564266 None] Terminate volume connection completed successfully. Jun 23 20:25:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-36f50e64-eac2-4a8b-876c-0f2640673aea req-a72c0299-194b-4efb-a192-fd31c93d57bb tempest-TestMinimumBasicScenario-1383564266 None] Deleting attachment 1b56c53d-bd81-4b5f-93f0-55f044924f99. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:25:33 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.info" returned: 0 in 0.688s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:33 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.info is being set with open permissions: ugo+rw Jun 23 20:25:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:33 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.info Jun 23 20:25:33 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:34 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.info" returned: 0 in 0.668s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.586s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-555b9aab-5961-4378-936a-56f968bd0138 tempest-VolumesDeleteCascade-1166775289 None] Create snapshot completed successfully Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Acquiring lock "cinder-c1257213-4eb9-4182-ab0b-dd162de5cc40-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Lock "cinder-c1257213-4eb9-4182-ab0b-dd162de5cc40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Acquiring lock "cinder-quobyte-c1257213-4eb9-4182-ab0b-dd162de5cc40" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Lock "cinder-quobyte-c1257213-4eb9-4182-ab0b-dd162de5cc40" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[82255c5b-1d1e-4609-b3b5-5e6358c62519]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:35 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 Jun 23 20:25:35 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Flow 'volume_create_manager' (b8c4e881-7836-42c7-b8f4-16268b18fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5a6ddb-1ce5-4ef2-a085-d84e0f763eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5a6ddb-1ce5-4ef2-a085-d84e0f763eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1025244459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a806613-e107-4da2-9533-655849a9dc29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6681dfb8258c4390b69a8ed195441f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3298f403-3471-4a14-ab51-1b319d3a604f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:25:35Z,use_quota=True,user_id='b80b8368eb644bcb930ff6d3d74edd6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8edebe2-ac7b-4209-8094-2224ef641e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8edebe2-ac7b-4209-8094-2224ef641e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a29c66d-9a0e-49f5-99e6-9c7d0c28713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a29c66d-9a0e-49f5-99e6-9c7d0c28713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a806613-e107-4da2-9533-655849a9dc29', 'volume_name': 'volume-4a806613-e107-4da2-9533-655849a9dc29', 'volume_size': 1, 'snapshot_id': '3298f403-3471-4a14-ab51-1b319d3a604f'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cf7d7a-cc4a-456d-8e62-76b8fad228c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cf7d7a-cc4a-456d-8e62-76b8fad228c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a9a039-ae7b-4eeb-a7b4-3c90a20628a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:35 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Volume 4a806613-e107-4da2-9533-655849a9dc29: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a806613-e107-4da2-9533-655849a9dc29', 'volume_size': 1, 'snapshot_id': '3298f403-3471-4a14-ab51-1b319d3a604f'} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-3298f403-3471-4a14-ab51-1b319d3a604f-4a806613-e107-4da2-9533-655849a9dc29" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-3298f403-3471-4a14-ab51-1b319d3a604f-4a806613-e107-4da2-9533-655849a9dc29" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Creating volume 4a806613-e107-4da2-9533-655849a9dc29 from snapshot 3298f403-3471-4a14-ab51-1b319d3a604f {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-4a806613-e107-4da2-9533-655849a9dc29" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-4a806613-e107-4da2-9533-655849a9dc29" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] snapshot: 3298f403-3471-4a14-ab51-1b319d3a604f, volume: 4a806613-e107-4da2-9533-655849a9dc29, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd59ccd-8f72-41c3-9821-9573dc5aa74c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:35 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f Jun 23 20:25:35 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:36 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40" returned: 0 in 0.855s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:36 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40 Jun 23 20:25:36 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:36 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f" returned: 0 in 0.885s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75e061db-19f5-4152-a896-47babcfd0ef3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fbe19e-f83d-48d1-804c-6c3a21d5ab26]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:36 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 Jun 23 20:25:36 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:36 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1257213-4eb9-4182-ab0b-dd162de5cc40" returned: 0 in 0.731s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Lock "cinder-quobyte-c1257213-4eb9-4182-ab0b-dd162de5cc40" released by "delete_volume" :: held 1.637s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Created reservations ['6e80cf49-3df0-47b1-a270-e0e20645f7f1', '9551d61b-b57d-4500-9ae3-23542a310296', '20f121bc-7bcd-4ceb-9bf4-ab81d0f7ba99', 'fff7e60c-ac92-4f06-adf0-8af7c6ee354c'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:36 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:25:36 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:37 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3" returned: 0 in 1.013s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:37 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:25:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:37 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 Jun 23 20:25:37 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:37 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.923s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:37 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:25:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Deleted volume successfully. Jun 23 20:25:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cccf74a9-1800-40d1-b294-553b5abfe102 tempest-TestMinimumBasicScenario-1383564266 None] Lock "cinder-c1257213-4eb9-4182-ab0b-dd162de5cc40-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:46 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29" returned: 0 in 8.774s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e07f96a-c7a9-4c04-8b80-0147110223cc]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:46 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 Jun 23 20:25:46 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:46 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:25:46 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:46 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=39,cinder:UPDATE=29,cinder:INSERT=11,cinder:DELETE=2 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:25:47 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.921s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:25:47 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3" returned: 0 in 1.376s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:25:47 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Converted 1024.00 MB image at 116.70 MB/s Jun 23 20:25:47 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 is being set with open permissions: ugo+rw Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:47 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 Jun 23 20:25:47 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:47 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=62,cinder:SELECT=53,cinder:INSERT=15,cinder:DELETE=6 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:25:48 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29" returned: 0 in 0.858s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-4a806613-e107-4da2-9533-655849a9dc29" released by "_copy_volume_from_snapshot" :: held 13.027s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-3298f403-3471-4a14-ab51-1b319d3a604f-4a806613-e107-4da2-9533-655849a9dc29" released by "_create_volume_from_snapshot" :: held 13.060s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.076s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a9a039-ae7b-4eeb-a7b4-3c90a20628a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a806613-e107-4da2-9533-655849a9dc29', 'volume_size': 1, 'snapshot_id': '3298f403-3471-4a14-ab51-1b319d3a604f'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364a98bd-fcb0-44a4-bbb6-e0ddad126f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:25:48 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Volume volume-4a806613-e107-4da2-9533-655849a9dc29 (4a806613-e107-4da2-9533-655849a9dc29): created successfully Jun 23 20:25:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364a98bd-fcb0-44a4-bbb6-e0ddad126f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:25:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Flow 'volume_create_manager' (b8c4e881-7836-42c7-b8f4-16268b18fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:25:48 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4637ed26-e2c8-4ced-bf56-68c621cd7f12 tempest-VolumesDeleteCascade-1166775289 None] Created volume successfully. Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-75e061db-19f5-4152-a896-47babcfd0ef3-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-75e061db-19f5-4152-a896-47babcfd0ef3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Performing cascade delete. {{(pid=93739) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-3298f403-3471-4a14-ab51-1b319d3a604f-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-3298f403-3471-4a14-ab51-1b319d3a604f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-75e061db-19f5-4152-a896-47babcfd0ef3" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-75e061db-19f5-4152-a896-47babcfd0ef3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-3298f403-3471-4a14-ab51-1b319d3a604f" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-3298f403-3471-4a14-ab51-1b319d3a604f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Deleting offline snapshot 3298f403-3471-4a14-ab51-1b319d3a604f of volume 75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] snapshot_file for this snap is: volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efd8fb6-c82b-41b8-91d6-f1e5c9626277]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:49 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f Jun 23 20:25:49 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-f286a978-11d0-4beb-a088-dd43a35d21f0 req-48d6c64e-ebcf-4bb0-bdf5-9e15275ba5c0 tempest-TestShelveInstance-815534228 None] Terminate volume connection completed successfully. Jun 23 20:25:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-f286a978-11d0-4beb-a088-dd43a35d21f0 req-48d6c64e-ebcf-4bb0-bdf5-9e15275ba5c0 tempest-TestShelveInstance-815534228 None] Deleting attachment 39777458-a69d-446a-99b7-4e35a6ed7024. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:25:50 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f" returned: 0 in 1.011s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75e061db-19f5-4152-a896-47babcfd0ef3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:25:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d961a99-6fd4-446a-a52d-f9faba4b7db3]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:50 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 Jun 23 20:25:50 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:51 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3" returned: 0 in 0.995s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:51 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f Jun 23 20:25:51 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:52 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f" returned: 0 in 1.137s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:52 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f Jun 23 20:25:52 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:54 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3.3298f403-3471-4a14-ab51-1b319d3a604f" returned: 0 in 1.505s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-3298f403-3471-4a14-ab51-1b319d3a604f" released by "_delete_snapshot" :: held 4.773s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-75e061db-19f5-4152-a896-47babcfd0ef3" released by "delete_snapshot" :: held 4.801s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Created reservations ['7033d19e-78a6-46c9-86cc-db334abe0c7b', '994c85b6-17b1-4b80-be04-e4a7c70ea1f1', 'b3d6c1c8-ea7e-44ff-926c-92f870a171ef', '3ba4207d-f1b8-414e-8330-4dba9bc98b69'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:25:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Delete snapshot completed successfully. Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-3298f403-3471-4a14-ab51-1b319d3a604f-delete_snapshot" released by "delete_snapshot" :: held 5.012s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Snapshots deleted, issuing volume delete {{(pid=93739) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-75e061db-19f5-4152-a896-47babcfd0ef3" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-75e061db-19f5-4152-a896-47babcfd0ef3" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf52b98-69f0-4d6a-9554-8ce32091b8c7]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:54 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 Jun 23 20:25:54 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:55 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3" returned: 0 in 1.159s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:55 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3 Jun 23 20:25:55 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:56 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-75e061db-19f5-4152-a896-47babcfd0ef3" returned: 0 in 1.133s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-75e061db-19f5-4152-a896-47babcfd0ef3" released by "delete_volume" :: held 2.387s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6f52e-d035-4df5-8778-ebdea1c68e7a]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Created reservations ['3364c7de-79fc-4f45-be08-57dc5eba2b17', 'cd1497bc-d458-4df1-9270-752e7ff422f6', '66b70bae-a243-45c0-9ac0-7dcfedab96e1', '4d0b3c94-6282-4b42-a480-b9a0f4501f9e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:25:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:57 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:25:57 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:57 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:25:57 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-4a806613-e107-4da2-9533-655849a9dc29-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-4a806613-e107-4da2-9533-655849a9dc29-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "cinder-quobyte-4a806613-e107-4da2-9533-655849a9dc29" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-4a806613-e107-4da2-9533-655849a9dc29" acquired by "delete_volume" :: waited 0.034s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbdfc1b-bd97-4171-890d-b1cf96721e37]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:58 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 0 in 1.275s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:58 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.129s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:25:58 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Deleted volume successfully. Jun 23 20:25:58 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fd655ad9-e0ce-4d12-be5d-8bdb08097307 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-75e061db-19f5-4152-a896-47babcfd0ef3-delete_volume" released by "delete_volume" :: held 8.881s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:25:58 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 Jun 23 20:25:58 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:58 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:25:58 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:59 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29" returned: 0 in 1.391s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:25:59 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29 Jun 23 20:25:59 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:25:59 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jun 23 20:25:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 1 in 1.560s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:25:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:25:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.961s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-e74a4656-abe6-40a9-86f3-2a75791b5316', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c56dbd72-5d6f-4929-b169-4b133e44109b', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:26:00 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-dbb15373-0c64-492c-b428-46d54113dd5e req-d6422822-b238-4f49-937e-6069ae48fa36 tempest-TestShelveInstance-815534228 None] attachment_update completed successfully. Jun 23 20:26:00 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a806613-e107-4da2-9533-655849a9dc29" returned: 0 in 1.021s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-quobyte-4a806613-e107-4da2-9533-655849a9dc29" released by "delete_volume" :: held 2.506s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Created reservations ['95aca0e7-7d71-45a2-a3ce-9eaa09a8dd60', '58b4aeaf-4a33-43a0-b830-60c7d2396d8b', '4bd9a692-96cd-445b-bd41-9f7c12aedfbb', 'af7eb6e2-213e-4d55-b8fe-9db6856a4692'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:00 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:26:00 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:02 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.202s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:02 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:26:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Deleted volume successfully. Jun 23 20:26:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e344d5d0-ce16-4a6f-8956-9775fb54d407 tempest-VolumesDeleteCascade-1166775289 None] Lock "cinder-4a806613-e107-4da2-9533-655849a9dc29-delete_volume" released by "delete_volume" :: held 4.069s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Flow 'volume_create_manager' (4038b5e3-0982-4d85-9cab-6fed668a83a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990f1c96-4715-4746-8a6a-06683c1681be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990f1c96-4715-4746-8a6a-06683c1681be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1155948477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c17f08c-dba9-410d-b6a0-138351c6f676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053759b565674898ad145c06b6a1a5fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:06Z,use_quota=True,user_id='98e747c8a3414e4a8d4cb0bdb91336e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c573e4b2-3b93-4a96-98b2-3b8e16674263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c573e4b2-3b93-4a96-98b2-3b8e16674263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85d011c-311b-4ac1-a8fa-c5070764aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85d011c-311b-4ac1-a8fa-c5070764aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c17f08c-dba9-410d-b6a0-138351c6f676', 'volume_name': 'volume-7c17f08c-dba9-410d-b6a0-138351c6f676', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d11e2ef-5ff6-4764-a5f7-f2d314cbae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d11e2ef-5ff6-4764-a5f7-f2d314cbae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fe0a1c-34d1-4c9d-818e-e5065816b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:06 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Volume 7c17f08c-dba9-410d-b6a0-138351c6f676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c17f08c-dba9-410d-b6a0-138351c6f676', 'volume_size': 1} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1155948477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c17f08c-dba9-410d-b6a0-138351c6f676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053759b565674898ad145c06b6a1a5fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:06Z,use_quota=True,user_id='98e747c8a3414e4a8d4cb0bdb91336e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Creating volume 7c17f08c-dba9-410d-b6a0-138351c6f676 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:26:06 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:26:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:06 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 1073741824 Jun 23 20:26:06 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:07 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 1073741824" returned: 0 in 1.373s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:08 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 Jun 23 20:26:08 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:08 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676" returned: 0 in 0.697s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:26:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fe0a1c-34d1-4c9d-818e-e5065816b311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c17f08c-dba9-410d-b6a0-138351c6f676', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dc811b-d4ca-4fae-a031-49e48fa730fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:08 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Volume volume-7c17f08c-dba9-410d-b6a0-138351c6f676 (7c17f08c-dba9-410d-b6a0-138351c6f676): created successfully Jun 23 20:26:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dc811b-d4ca-4fae-a031-49e48fa730fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Flow 'volume_create_manager' (4038b5e3-0982-4d85-9cab-6fed668a83a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9630ae82-a4f9-47e5-9db9-d69b3cc42781 tempest-VolumesMetadataTest-1610683788 None] Created volume successfully. Jun 23 20:26:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Acquiring lock "cinder-7c17f08c-dba9-410d-b6a0-138351c6f676-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Lock "cinder-7c17f08c-dba9-410d-b6a0-138351c6f676-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Acquiring lock "cinder-quobyte-7c17f08c-dba9-410d-b6a0-138351c6f676" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Lock "cinder-quobyte-7c17f08c-dba9-410d-b6a0-138351c6f676" acquired by "delete_volume" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7d3faa-3d7f-4484-99b6-ff4e4345f76f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:10 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 Jun 23 20:26:10 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:11 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676" returned: 0 in 0.982s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:11 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676 Jun 23 20:26:11 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:12 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7c17f08c-dba9-410d-b6a0-138351c6f676" returned: 0 in 0.672s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Lock "cinder-quobyte-7c17f08c-dba9-410d-b6a0-138351c6f676" released by "delete_volume" :: held 1.721s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Created reservations ['841333e7-a664-4f24-a7ba-9393c9373adb', '3231b0df-ae82-4a24-b905-bd8aad1785d1', '23106dc5-2232-479d-bc87-e695b5c29a2f', '9828b83c-d8fa-430f-88aa-fa055ffe50f6'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:12 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:26:12 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:13 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.229s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:13 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:26:13 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Deleted volume successfully. Jun 23 20:26:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c2200a65-da98-4fc6-9716-ee1dcef95751 tempest-VolumesMetadataTest-1610683788 None] Lock "cinder-7c17f08c-dba9-410d-b6a0-138351c6f676-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Flow 'volume_create_manager' (e108da8d-af32-4700-b846-80ee68338a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ce1343-a4a4-48dc-9a61-46b02cdd3e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ce1343-a4a4-48dc-9a61-46b02cdd3e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1664306039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c3e8da-e3cc-4d54-828d-71526c4012d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3821f62f7649ada27bb46afe6989ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:21Z,use_quota=True,user_id='47d7fc764ceb4cbd9b6ad84c9b6423f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c79f11-8987-4133-b9d2-d9a7fe3b8bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c79f11-8987-4133-b9d2-d9a7fe3b8bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700249d4-6548-4c76-bd0a-474515fd3cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700249d4-6548-4c76-bd0a-474515fd3cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c3e8da-e3cc-4d54-828d-71526c4012d9', 'volume_name': 'volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afd5d51-ceb2-4f58-8125-6cd81aed560a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afd5d51-ceb2-4f58-8125-6cd81aed560a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ce6da6-8780-4657-82b4-b4e1d27bc4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:20 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Volume e3c3e8da-e3cc-4d54-828d-71526c4012d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9', 'volume_size': 1} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1664306039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c3e8da-e3cc-4d54-828d-71526c4012d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3821f62f7649ada27bb46afe6989ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:21Z,use_quota=True,user_id='47d7fc764ceb4cbd9b6ad84c9b6423f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Creating volume e3c3e8da-e3cc-4d54-828d-71526c4012d9 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:26:20 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:26:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:21 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 1073741824 Jun 23 20:26:21 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Flow 'volume_create_manager' (1ddfe76c-65d9-4d7f-882e-5451b9b2ce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbceade-e65f-4605-9817-b35a5ebb6237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbceade-e65f-4605-9817-b35a5ebb6237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-996379324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91710bb6-08d2-42e9-a6d0-da7dbdb72352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842022b24944449a50c036c9a2c5f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:22Z,use_quota=True,user_id='1bfc70511f0840429d6866bc062ab6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1e9e2b-6197-4206-a103-4067cca34fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1e9e2b-6197-4206-a103-4067cca34fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa7bc86-4cac-42a7-8628-0979331c6256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa7bc86-4cac-42a7-8628-0979331c6256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91710bb6-08d2-42e9-a6d0-da7dbdb72352', 'volume_name': 'volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670c8605-2bbb-4341-b7d7-7620495d4c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670c8605-2bbb-4341-b7d7-7620495d4c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5537a22-e0e3-496f-b7d0-d508c16a2439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:21 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Volume 91710bb6-08d2-42e9-a6d0-da7dbdb72352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352', 'volume_size': 1} Jun 23 20:26:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:22 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 1073741824" returned: 0 in 1.282s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:22 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 Jun 23 20:26:22 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:23 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9" returned: 0 in 0.864s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.394s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-996379324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91710bb6-08d2-42e9-a6d0-da7dbdb72352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842022b24944449a50c036c9a2c5f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:22Z,use_quota=True,user_id='1bfc70511f0840429d6866bc062ab6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Creating volume 91710bb6-08d2-42e9-a6d0-da7dbdb72352 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:26:23 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:23 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 1073741824 Jun 23 20:26:23 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ce6da6-8780-4657-82b4-b4e1d27bc4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a09d22-7a6f-4969-a924-c8b9fb2e5557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:23 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Volume volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 (e3c3e8da-e3cc-4d54-828d-71526c4012d9): created successfully Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a09d22-7a6f-4969-a924-c8b9fb2e5557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Flow 'volume_create_manager' (e108da8d-af32-4700-b846-80ee68338a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:23 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7f21a4ec-4cfe-4484-b603-246d76addfc4 tempest-AttachVolumeNegativeTest-938637596 None] Created volume successfully. Jun 23 20:26:24 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 1073741824" returned: 0 in 1.177s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:24 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 Jun 23 20:26:24 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:25 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352" returned: 0 in 0.725s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:26:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5537a22-e0e3-496f-b7d0-d508c16a2439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d143ec87-acf0-49cc-b900-d5aba0b581e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:25 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Volume volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 (91710bb6-08d2-42e9-a6d0-da7dbdb72352): created successfully Jun 23 20:26:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d143ec87-acf0-49cc-b900-d5aba0b581e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Flow 'volume_create_manager' (1ddfe76c-65d9-4d7f-882e-5451b9b2ce92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-93aacc16-3288-417e-ac87-df1478451e5b tempest-VolumesTransfersV357Test-1684432781 None] Created volume successfully. Jun 23 20:26:26 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-644f2e44-7a01-465e-879a-c4c6ee596d5f tempest-VolumesTransfersV357Test-654620583 None] Transfer volume completed successfully. Jun 23 20:26:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-689505a6-8169-493e-bd49-e079801026dd req-6af02f6c-e332-4c47-8188-68e44a8b2d13 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-689505a6-8169-493e-bd49-e079801026dd req-6af02f6c-e332-4c47-8188-68e44a8b2d13 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:27 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[744b23ab-ffaf-4700-a2cc-df481865f4cf]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-689505a6-8169-493e-bd49-e079801026dd req-6af02f6c-e332-4c47-8188-68e44a8b2d13 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:27 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 Jun 23 20:26:27 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Acquiring lock "cinder-91710bb6-08d2-42e9-a6d0-da7dbdb72352-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Lock "cinder-91710bb6-08d2-42e9-a6d0-da7dbdb72352-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Acquiring lock "cinder-quobyte-91710bb6-08d2-42e9-a6d0-da7dbdb72352" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Lock "cinder-quobyte-91710bb6-08d2-42e9-a6d0-da7dbdb72352" acquired by "delete_volume" :: waited 0.040s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c66290f-5d01-44c4-b6a5-a4593b744739]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:28 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 Jun 23 20:26:28 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:29 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-689505a6-8169-493e-bd49-e079801026dd req-6af02f6c-e332-4c47-8188-68e44a8b2d13 tempest-AttachVolumeNegativeTest-938637596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9" returned: 0 in 1.591s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-689505a6-8169-493e-bd49-e079801026dd req-6af02f6c-e332-4c47-8188-68e44a8b2d13 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.630s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-689505a6-8169-493e-bd49-e079801026dd req-6af02f6c-e332-4c47-8188-68e44a8b2d13 tempest-AttachVolumeNegativeTest-938637596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a602204-ffcc-47fe-8b04-bc5a0726fd05', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:26:29 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352" returned: 0 in 1.379s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-689505a6-8169-493e-bd49-e079801026dd req-6af02f6c-e332-4c47-8188-68e44a8b2d13 tempest-AttachVolumeNegativeTest-938637596 None] attachment_update completed successfully. Jun 23 20:26:29 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352 Jun 23 20:26:29 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:30 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-91710bb6-08d2-42e9-a6d0-da7dbdb72352" returned: 0 in 0.914s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Lock "cinder-quobyte-91710bb6-08d2-42e9-a6d0-da7dbdb72352" released by "delete_volume" :: held 2.378s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Created reservations ['513bf929-72d8-4833-93ca-621a54aeb5a3', 'b5a56690-47c0-4be9-bfa8-be4746a4df42', 'bacd603c-339e-42f5-836c-ba1949d9e45e', '604e9217-b73b-45b9-977f-35db275af476'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:30 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:26:30 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:31 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.882s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:31 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:26:31 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Deleted volume successfully. Jun 23 20:26:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-76016d9d-c1ec-4269-a120-104e6176a487 tempest-VolumesTransfersV357Test-785347609 None] Lock "cinder-91710bb6-08d2-42e9-a6d0-da7dbdb72352-delete_volume" released by "delete_volume" :: held 3.751s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Flow 'volume_create_manager' (c836df4e-9fa3-4761-a4d1-eef1f74ee030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9ca8fe-5200-4dcf-a0bf-e824b060ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9ca8fe-5200-4dcf-a0bf-e824b060ec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-503446800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05bd844-7712-4689-8268-036daa7265ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842022b24944449a50c036c9a2c5f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:33Z,use_quota=True,user_id='1bfc70511f0840429d6866bc062ab6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d822faf7-5a09-4b8b-a1d3-ab88e04a7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d822faf7-5a09-4b8b-a1d3-ab88e04a7d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac01a8e5-74ea-4c71-ade7-b4b12462618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac01a8e5-74ea-4c71-ade7-b4b12462618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05bd844-7712-4689-8268-036daa7265ec', 'volume_name': 'volume-a05bd844-7712-4689-8268-036daa7265ec', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ef0742-c42f-4871-b0ed-28cb14afb0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ef0742-c42f-4871-b0ed-28cb14afb0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02eb27c3-b865-4d12-9ed1-5035966f8327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:32 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Volume a05bd844-7712-4689-8268-036daa7265ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05bd844-7712-4689-8268-036daa7265ec', 'volume_size': 1} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-503446800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05bd844-7712-4689-8268-036daa7265ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842022b24944449a50c036c9a2c5f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:33Z,use_quota=True,user_id='1bfc70511f0840429d6866bc062ab6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Creating volume a05bd844-7712-4689-8268-036daa7265ec {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:26:32 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:26:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:32 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec 1073741824 Jun 23 20:26:32 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:33 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec 1073741824" returned: 0 in 1.109s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:33 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec Jun 23 20:26:33 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:34 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec" returned: 0 in 0.872s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:26:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02eb27c3-b865-4d12-9ed1-5035966f8327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05bd844-7712-4689-8268-036daa7265ec', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097755c7-3c7f-4b92-94ac-c3cab0b83b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:34 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Volume volume-a05bd844-7712-4689-8268-036daa7265ec (a05bd844-7712-4689-8268-036daa7265ec): created successfully Jun 23 20:26:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097755c7-3c7f-4b92-94ac-c3cab0b83b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Flow 'volume_create_manager' (c836df4e-9fa3-4761-a4d1-eef1f74ee030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1963a42d-66f3-4b9f-aa2f-9af4ca33b590 tempest-VolumesTransfersV357Test-1684432781 None] Created volume successfully. Jun 23 20:26:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Acquiring lock "cinder-a05bd844-7712-4689-8268-036daa7265ec-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Lock "cinder-a05bd844-7712-4689-8268-036daa7265ec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Acquiring lock "cinder-quobyte-a05bd844-7712-4689-8268-036daa7265ec" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Lock "cinder-quobyte-a05bd844-7712-4689-8268-036daa7265ec" acquired by "delete_volume" :: waited 0.038s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:36 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5e275-250c-4945-9011-79e1e3b3b74c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:36 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec Jun 23 20:26:36 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-5fd4108f-7c94-42c6-9336-94e34b1d855b req-1e99ee6d-4c0d-4b95-a778-a4505b424247 tempest-AttachVolumeNegativeTest-938637596 None] Terminate volume connection completed successfully. Jun 23 20:26:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-5fd4108f-7c94-42c6-9336-94e34b1d855b req-1e99ee6d-4c0d-4b95-a778-a4505b424247 tempest-AttachVolumeNegativeTest-938637596 None] Deleting attachment 3a602204-ffcc-47fe-8b04-bc5a0726fd05. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:26:37 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec" returned: 0 in 0.861s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:37 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec Jun 23 20:26:37 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Flow 'volume_create_manager' (fbfd3459-9363-45a9-bb34-7521a8770d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f568dc-9a6b-4836-927e-a62d6a29a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f568dc-9a6b-4836-927e-a62d6a29a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-397526133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a276d86-d41a-41ac-9812-87c0157b90ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bc7a2c68b54d81b176c7e36fb9ccbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:38Z,use_quota=True,user_id='fd58a0a0dd5e45e28a7395ea7db3b7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb16c0c5-1b73-4a22-a1ae-a11a4999836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb16c0c5-1b73-4a22-a1ae-a11a4999836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad921fb-3b7f-49ff-a823-6ffe52cfa441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:37 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad921fb-3b7f-49ff-a823-6ffe52cfa441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a276d86-d41a-41ac-9812-87c0157b90ac', 'volume_name': 'volume-4a276d86-d41a-41ac-9812-87c0157b90ac', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34cc9b7-0ff4-47c6-92d6-ec5d248c39f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34cc9b7-0ff4-47c6-92d6-ec5d248c39f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea62968-ae42-4964-b88e-6b4bd445e01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Volume 4a276d86-d41a-41ac-9812-87c0157b90ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a276d86-d41a-41ac-9812-87c0157b90ac', 'volume_size': 1} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-397526133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a276d86-d41a-41ac-9812-87c0157b90ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bc7a2c68b54d81b176c7e36fb9ccbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:38Z,use_quota=True,user_id='fd58a0a0dd5e45e28a7395ea7db3b7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Creating volume 4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:26:38 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a05bd844-7712-4689-8268-036daa7265ec" returned: 0 in 0.760s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:38 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac 1073741824 Jun 23 20:26:38 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Lock "cinder-quobyte-a05bd844-7712-4689-8268-036daa7265ec" released by "delete_volume" :: held 1.709s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Created reservations ['0b469e5f-0b8a-41c7-9f8d-1604b6f14432', '6a2ba8f5-5dd2-4f29-a231-bacf54c7f7cd', '3923cdd0-1f87-4eae-84c1-1afc0f1d48fb', '57ef08f2-9338-41e9-8534-70057fea1cc7'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:38 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:26:38 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:38 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.809s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:26:39 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Deleted volume successfully. Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fc41000c-91fd-438a-8408-c6a1ee751bc4 tempest-VolumesTransfersV357Test-785347609 None] Lock "cinder-a05bd844-7712-4689-8268-036daa7265ec-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:39 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac 1073741824" returned: 0 in 1.099s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:39 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac Jun 23 20:26:39 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:39 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac" returned: 0 in 0.796s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea62968-ae42-4964-b88e-6b4bd445e01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a276d86-d41a-41ac-9812-87c0157b90ac', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c52693-3c6f-48f2-bcd3-c5e633fe3f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:40 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Volume volume-4a276d86-d41a-41ac-9812-87c0157b90ac (4a276d86-d41a-41ac-9812-87c0157b90ac): created successfully Jun 23 20:26:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c52693-3c6f-48f2-bcd3-c5e633fe3f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Flow 'volume_create_manager' (fbfd3459-9363-45a9-bb34-7521a8770d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-94b62494-d3b2-41b5-afce-38f9c0cb8cfb tempest-TestStampPattern-1511669606 None] Created volume successfully. Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Flow 'volume_create_manager' (6e7df709-4df5-4f8d-9ee8-8b8aca1a2d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb6b4ed-f863-4a57-932c-a4ae21ff19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb6b4ed-f863-4a57-932c-a4ae21ff19df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2030204875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fa37108d784150ac6f5477ddc03b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:46Z,use_quota=True,user_id='8971a14290d743f6829c6d810be3048e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636f1bfc-f517-420a-8bfa-4d8c97284a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636f1bfc-f517-420a-8bfa-4d8c97284a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d74818d-ca6a-4c1f-ab2d-01b4161df278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d74818d-ca6a-4c1f-ab2d-01b4161df278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56d7cfb-1268-4a74-9a47-f5f6ae3c99fe', 'volume_name': 'volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b94c370-1254-4ba4-bc8e-cd31ccc24228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b94c370-1254-4ba4-bc8e-cd31ccc24228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968a8bf8-c3dc-471d-91b5-733abbc56385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:46 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Volume d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe', 'volume_size': 1} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2030204875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fa37108d784150ac6f5477ddc03b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:46Z,use_quota=True,user_id='8971a14290d743f6829c6d810be3048e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Creating volume d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:26:46 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:46 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe 1073741824 Jun 23 20:26:46 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:46 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:26:46 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:47 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.731s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:26:47 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe 1073741824" returned: 0 in 1.003s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:26:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:26:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:26:47 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=68,cinder:SELECT=55,cinder:INSERT=11,cinder:DELETE=7 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:26:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:47 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe Jun 23 20:26:47 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "cinder-e3c3e8da-e3cc-4d54-828d-71526c4012d9-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-e3c3e8da-e3cc-4d54-828d-71526c4012d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=59,cinder:UPDATE=65,cinder:DELETE=4,cinder:INSERT=19 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "cinder-quobyte-e3c3e8da-e3cc-4d54-828d-71526c4012d9" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-quobyte-e3c3e8da-e3cc-4d54-828d-71526c4012d9" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b714ed7e-1a14-4e59-a41c-61c66977f270]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:48 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" returned: 0 in 0.845s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:48 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 Jun 23 20:26:48 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968a8bf8-c3dc-471d-91b5-733abbc56385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cc82e0-c250-4d2c-8b90-3122c026658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:48 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Volume volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe (d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe): created successfully Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cc82e0-c250-4d2c-8b90-3122c026658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Flow 'volume_create_manager' (6e7df709-4df5-4f8d-9ee8-8b8aca1a2d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:48 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-757731f3-3941-4aa6-bfc6-b0ccdc6bcb8a tempest-VolumesCloneTest-934499365 None] Created volume successfully. Jun 23 20:26:48 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9" returned: 0 in 0.798s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:49 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9 Jun 23 20:26:49 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:49 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e3c3e8da-e3cc-4d54-828d-71526c4012d9" returned: 0 in 0.691s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-quobyte-e3c3e8da-e3cc-4d54-828d-71526c4012d9" released by "delete_volume" :: held 1.539s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Created reservations ['cfa89e3a-3fce-433c-adcf-49db493faa0c', '03dad8b2-ba76-4932-a2db-1d2102ebf927', '9e6c2018-3c26-4fed-90b4-b43064066a2d', '49fc9f0e-6f47-4826-b4f4-580f78e96e33'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:49 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:26:49 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:49 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Flow 'volume_create_manager' (468c505e-b705-416b-b477-18fcce7a0fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d909d43-0b6c-43bd-884f-1e5681ec984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d909d43-0b6c-43bd-884f-1e5681ec984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2111316930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5ec137-bf98-4cc8-bf7a-d1f0716de254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fa37108d784150ac6f5477ddc03b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:26:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe,status='creating',terminated_at=None,updated_at=2026-06-23T18:26:50Z,use_quota=True,user_id='8971a14290d743f6829c6d810be3048e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e2c852-daad-48e6-bb38-3d6e1cc30114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e2c852-daad-48e6-bb38-3d6e1cc30114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51e3661-eb6b-4b62-9ac1-b7703483562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51e3661-eb6b-4b62-9ac1-b7703483562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3a5ec137-bf98-4cc8-bf7a-d1f0716de254', 'volume_name': 'volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254', 'volume_size': 2, 'source_volid': 'd56d7cfb-1268-4a74-9a47-f5f6ae3c99fe', 'source_volstatus': 'available'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847b749d-b220-4761-981b-1a931320edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847b749d-b220-4761-981b-1a931320edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213a3d4c-158e-43a6-916f-206cfc9618b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:26:50 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Volume 3a5ec137-bf98-4cc8-bf7a-d1f0716de254: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254', 'volume_size': 2, 'source_volid': 'd56d7cfb-1268-4a74-9a47-f5f6ae3c99fe', 'source_volstatus': 'available'} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:50 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Cloning volume d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe to volume 3a5ec137-bf98-4cc8-bf7a-d1f0716de254 Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Creating offline snapshot df0bdfe8-88a7-49dd-a540-660d655df9fd of volume d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[be942010-4dee-4a3e-87a1-208f3a1f758f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:50 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe Jun 23 20:26:50 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "cinder-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "cinder-quobyte-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-quobyte-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d8da7d-869b-47b1-9a29-9b8ef9d17716]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:50 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.807s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:26:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Deleted volume successfully. Jun 23 20:26:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-62ed70f0-2bf6-469d-9008-38b1a4ecb73d tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-e3c3e8da-e3cc-4d54-828d-71526c4012d9-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:50 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 Jun 23 20:26:50 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:51 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" returned: 0 in 0.867s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:51 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd 1G Jun 23 20:26:51 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:51 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1" returned: 0 in 0.825s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:51 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1 Jun 23 20:26:51 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:52 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd 1G" returned: 0 in 1.273s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:52 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd Jun 23 20:26:52 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:52 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1" returned: 0 in 0.963s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-quobyte-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1" released by "delete_volume" :: held 1.850s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Created reservations ['659a6693-9097-4536-bc59-78f124c3dc73', 'bc5a83af-7e95-46a4-9346-e75880b7a860', '4a1928fe-290c-43cb-83cd-23e50fd7f97d', 'a1b2fd5b-6f5d-4607-a13a-3afa2df5778b'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:52 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:26:52 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "cinder-0588b74d-964f-4fc7-9590-d50b1c432774-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-0588b74d-964f-4fc7-9590-d50b1c432774-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "cinder-quobyte-0588b74d-964f-4fc7-9590-d50b1c432774" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-quobyte-0588b74d-964f-4fc7-9590-d50b1c432774" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4c63df-bd1f-44c8-aa2d-689dbe21754d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:53 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 Jun 23 20:26:53 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:53 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd" returned: 0 in 1.215s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:53 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd is being set with open permissions: ugo+rw Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:53 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd Jun 23 20:26:53 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:53 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.959s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:26:53 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Deleted volume successfully. Jun 23 20:26:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-86dfa6e9-e645-43b2-9600-0cc49b2ddf65 tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-bb17fe4a-1ae0-4942-aa16-cde10eba8cd1-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:54 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774" returned: 0 in 1.012s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:54 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774 Jun 23 20:26:54 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:54 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd" returned: 0 in 0.910s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:54 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.info Jun 23 20:26:54 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:55 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0588b74d-964f-4fc7-9590-d50b1c432774" returned: 0 in 1.120s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-quobyte-0588b74d-964f-4fc7-9590-d50b1c432774" released by "delete_volume" :: held 2.251s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Created reservations ['4f5cc8fa-33a0-4947-8d8b-04cbc2c63149', '49a772ec-d92d-446a-a28b-0b49a02e0ae3', 'ea4f53b6-dd55-43f5-b64d-e8f28386c579', 'c3d779e5-cc96-4718-9342-d5624530dd00'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:55 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:26:55 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:55 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.info" returned: 0 in 1.261s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:55 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.info is being set with open permissions: ugo+rw Jun 23 20:26:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:55 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.info Jun 23 20:26:55 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:56 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.info" returned: 0 in 1.053s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Acquiring lock "cinder-quobyte-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Lock "cinder-quobyte-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] snapshot: df0bdfe8-88a7-49dd-a540-660d655df9fd, volume: 3a5ec137-bf98-4cc8-bf7a-d1f0716de254, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:26:56 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.269s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:26:56 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Deleted volume successfully. Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[679c1707-1ae9-425e-b953-fbd7c86bd940]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-995ec58e-ae4f-4dc4-8f8a-8864a5b8eab4 tempest-AttachVolumeNegativeTest-938637596 None] Lock "cinder-0588b74d-964f-4fc7-9590-d50b1c432774-delete_volume" released by "delete_volume" :: held 3.960s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:26:57 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd Jun 23 20:26:57 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:26:58 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jun 23 20:26:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd" returned: 0 in 1.474s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:26:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:26:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:26:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:26:58 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b0f582-57bf-47a7-88be-586eff27db23]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:26:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:26:58 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe Jun 23 20:26:58 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:00 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" returned: 0 in 1.761s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:00 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:27:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:00 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 Jun 23 20:27:00 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-927e8c76-ce78-4cee-973a-68f8159da092 tempest-TestShelveInstance-815534228 None] Terminate volume connection completed successfully. Jun 23 20:27:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-927e8c76-ce78-4cee-973a-68f8159da092 tempest-TestShelveInstance-815534228 None] Deleting attachment c56dbd72-5d6f-4929-b169-4b133e44109b. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:27:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Acquiring lock "cinder-e74a4656-abe6-40a9-86f3-2a75791b5316-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Lock "cinder-e74a4656-abe6-40a9-86f3-2a75791b5316-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Acquiring lock "cinder-quobyte-e74a4656-abe6-40a9-86f3-2a75791b5316" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Lock "cinder-quobyte-e74a4656-abe6-40a9-86f3-2a75791b5316" acquired by "delete_volume" :: waited 0.069s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:03 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd543a1-82b8-4cbe-9048-b2cacce3ac0c]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:04 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:27:04 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:06 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 0 in 2.341s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:06 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:27:06 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:07 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 1 in 1.834s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:27:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:07 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316 Jun 23 20:27:07 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:08 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" returned: 0 in 8.465s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:08 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0aa6a1-d6b7-4d31-9920-0c9e23f05c9b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:08 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e74a4656-abe6-40a9-86f3-2a75791b5316" returned: 0 in 0.906s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Lock "cinder-quobyte-e74a4656-abe6-40a9-86f3-2a75791b5316" released by "delete_volume" :: held 5.328s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:08 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe Jun 23 20:27:08 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:09 devstack cinder-volume[93739]: DEBUG cinder.quota [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Created reservations ['65f81633-d919-4c0c-81fe-47d43fea7e3a', 'b021b99f-962c-43fa-98f3-73a96e50f6c4', '5f6a2219-7ac1-4968-b20b-c8953cfee0b0', 'a78908e0-f22e-4aaf-9006-f9a9e61c3125'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:09 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:09 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:10 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:10 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" returned: 0 in 1.325s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:27:10 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Converted 1024.00 MB image at 120.95 MB/s Jun 23 20:27:10 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 is being set with open permissions: ugo+rw Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.842s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG cinder.manager [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Deleted volume successfully. Jun 23 20:27:10 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 Jun 23 20:27:10 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-c978e9e7-167c-46f0-adbe-7f2624025d9b req-f6da8d5b-d1e1-42be-87a5-dc91ee84c48f tempest-TestShelveInstance-815534228 None] Lock "cinder-e74a4656-abe6-40a9-86f3-2a75791b5316-delete_volume" released by "delete_volume" :: held 6.777s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:10 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" returned: 0 in 0.775s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Lock "cinder-quobyte-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" released by "_copy_volume_from_snapshot" :: held 13.959s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Acquiring lock "cinder-quobyte-df0bdfe8-88a7-49dd-a540-660d655df9fd" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Lock "cinder-quobyte-df0bdfe8-88a7-49dd-a540-660d655df9fd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Deleting offline snapshot df0bdfe8-88a7-49dd-a540-660d655df9fd of volume d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] snapshot_file for this snap is: volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dd2b36-aff3-4715-958c-8c1b188b1ede]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:11 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd Jun 23 20:27:11 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:11 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd" returned: 0 in 0.863s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:27:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8236fe0d-d191-4961-978e-debe05b594fb]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:12 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe Jun 23 20:27:12 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:13 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" returned: 0 in 1.294s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:13 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd Jun 23 20:27:13 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Flow 'volume_create_manager' (a5371d85-60ea-49c0-9b10-46319a30ec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e24850c-fe68-468f-a362-22de9e4c0ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e24850c-fe68-468f-a362-22de9e4c0ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1054323368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11edbec6-bada-4416-9e92-dd687e326bed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='905dad76867a4afda78f49cbf26664b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:13Z,use_quota=True,user_id='ad721ab7a33d4287a9c712fc450a536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c283bf1-5a1e-43ac-8973-c2361136df89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c283bf1-5a1e-43ac-8973-c2361136df89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955fedeb-4e1d-4b0a-b310-c93239dd2dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955fedeb-4e1d-4b0a-b310-c93239dd2dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11edbec6-bada-4416-9e92-dd687e326bed', 'volume_name': 'volume-11edbec6-bada-4416-9e92-dd687e326bed', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fd364f-274f-44e2-89b7-8bf8bbb62490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fd364f-274f-44e2-89b7-8bf8bbb62490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031ef590-7b5d-4582-8f25-748fddd86479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:13 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Volume 11edbec6-bada-4416-9e92-dd687e326bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11edbec6-bada-4416-9e92-dd687e326bed', 'volume_size': 1} Jun 23 20:27:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:14 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd" returned: 0 in 1.030s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:14 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd Jun 23 20:27:14 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:14 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe.df0bdfe8-88a7-49dd-a540-660d655df9fd" returned: 0 in 0.743s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:14 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Lock "cinder-quobyte-df0bdfe8-88a7-49dd-a540-660d655df9fd" released by "_delete_snapshot" :: held 4.106s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.918s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1054323368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11edbec6-bada-4416-9e92-dd687e326bed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='905dad76867a4afda78f49cbf26664b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:13Z,use_quota=True,user_id='ad721ab7a33d4287a9c712fc450a536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Creating volume 11edbec6-bada-4416-9e92-dd687e326bed {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:15 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213a3d4c-158e-43a6-916f-206cfc9618b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254', 'volume_size': 2, 'source_volid': 'd56d7cfb-1268-4a74-9a47-f5f6ae3c99fe', 'source_volstatus': 'available'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:15 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed 1073741824 Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e298b4-0672-405f-ad88-dc075a8985f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:15 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Volume volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 (3a5ec137-bf98-4cc8-bf7a-d1f0716de254): created successfully Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e298b4-0672-405f-ad88-dc075a8985f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Flow 'volume_create_manager' (468c505e-b705-416b-b477-18fcce7a0fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bdcbf2ff-fdfb-405c-98a3-5d7ef98ab495 tempest-VolumesCloneTest-934499365 None] Created volume successfully. Jun 23 20:27:15 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed 1073741824" returned: 0 in 0.897s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:16 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed Jun 23 20:27:16 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Acquiring lock "cinder-3a5ec137-bf98-4cc8-bf7a-d1f0716de254-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Lock "cinder-3a5ec137-bf98-4cc8-bf7a-d1f0716de254-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Acquiring lock "cinder-quobyte-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Lock "cinder-quobyte-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7cab4-e31c-4a21-b1e8-f797fd5454d2]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:16 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed" returned: 0 in 0.717s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:16 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 Jun 23 20:27:16 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031ef590-7b5d-4582-8f25-748fddd86479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11edbec6-bada-4416-9e92-dd687e326bed', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6419ee36-b2b4-496d-ac94-314f0814440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:16 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Volume volume-11edbec6-bada-4416-9e92-dd687e326bed (11edbec6-bada-4416-9e92-dd687e326bed): created successfully Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6419ee36-b2b4-496d-ac94-314f0814440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Flow 'volume_create_manager' (a5371d85-60ea-49c0-9b10-46319a30ec68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:16 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-c0931d78-3538-460b-b806-ddd0ea3fede0 req-48d8ce7a-5ec0-40aa-8b6e-46c09c632823 tempest-VolumesGetTestJSON-743316023 None] Created volume successfully. Jun 23 20:27:17 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" returned: 0 in 0.848s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:17 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254 Jun 23 20:27:17 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Acquiring lock "cinder-11edbec6-bada-4416-9e92-dd687e326bed-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Lock "cinder-11edbec6-bada-4416-9e92-dd687e326bed-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Acquiring lock "cinder-quobyte-11edbec6-bada-4416-9e92-dd687e326bed" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Lock "cinder-quobyte-11edbec6-bada-4416-9e92-dd687e326bed" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:17 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4999070b-4532-4784-aa86-a1fa1af1cc14]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:17 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed Jun 23 20:27:17 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:18 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" returned: 0 in 0.854s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Lock "cinder-quobyte-3a5ec137-bf98-4cc8-bf7a-d1f0716de254" released by "delete_volume" :: held 1.806s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Created reservations ['2c14f357-d579-4fe2-8e5c-71ef83eb45d8', 'cfe61727-67c6-493a-a2fd-8263d29071c0', '6b6f139a-b8d3-433e-b5f2-4f69e89d6014', '1629ba98-b421-43bc-b0be-ef4cbec6c8f7'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:18 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed" returned: 0 in 0.831s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:18 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:18 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:18 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed Jun 23 20:27:18 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Acquiring lock "cinder-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Lock "cinder-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Acquiring lock "cinder-quobyte-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Lock "cinder-quobyte-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" acquired by "delete_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4def6183-cb2a-40ec-b11c-bb4102181c89]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:19 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe Jun 23 20:27:19 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:19 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-11edbec6-bada-4416-9e92-dd687e326bed" returned: 0 in 0.761s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Lock "cinder-quobyte-11edbec6-bada-4416-9e92-dd687e326bed" released by "delete_volume" :: held 1.664s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:19 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.868s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:19 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Deleted volume successfully. Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG cinder.quota [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Created reservations ['569af00f-3c6f-4a90-8f0d-bd60cb88e87b', 'f1947691-f527-41d8-8bba-f7f5e2f08c18', '7bc521c2-2ad6-478d-9ce6-9abdddaaea18', '0abccee5-922a-4602-8dec-bf05dad0c8bb'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-a1d5c184-9beb-4b8c-a177-729d32bb3fec tempest-VolumesCloneTest-934499365 None] Lock "cinder-3a5ec137-bf98-4cc8-bf7a-d1f0716de254-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:19 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:19 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:20 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" returned: 0 in 1.244s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:20 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe Jun 23 20:27:20 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:20 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.003s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:20 devstack cinder-volume[93739]: DEBUG cinder.manager [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:20 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Deleted volume successfully. Jun 23 20:27:20 devstack cinder-volume[93739]: DEBUG cinder.coordination [req-190968df-d55a-4595-8042-eede355e7ea7 req-17a8caf2-6440-4c6d-bcb0-cb8057b5a10c tempest-VolumesGetTestJSON-743316023 None] Lock "cinder-11edbec6-bada-4416-9e92-dd687e326bed-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:21 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" returned: 0 in 0.789s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Lock "cinder-quobyte-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe" released by "delete_volume" :: held 2.127s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Created reservations ['9061dda6-14c9-444c-9e2d-1d1a2f6fb5bf', '34ef5014-07cf-474e-a22d-a8ce8891fec6', 'ba3e363b-158b-41e8-a1f4-68f6686ea75d', '3345bf82-d365-4a41-b566-338d2cfb65d3'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:21 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:21 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:22 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.777s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:22 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:22 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Deleted volume successfully. Jun 23 20:27:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d0a39e26-4cb6-4f04-9fb4-0afa98abd801 tempest-VolumesCloneTest-934499365 None] Lock "cinder-d56d7cfb-1268-4a74-9a47-f5f6ae3c99fe-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-a6a8c944-9031-43ab-abec-480627f4269a req-344dd71e-304d-4e23-81a7-e83a4ba74d3e tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-a6a8c944-9031-43ab-abec-480627f4269a req-344dd71e-304d-4e23-81a7-e83a4ba74d3e tempest-TestStampPattern-1511669606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:23 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb2b57-56db-4085-87e6-1407326160ca]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-a6a8c944-9031-43ab-abec-480627f4269a req-344dd71e-304d-4e23-81a7-e83a4ba74d3e tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:23 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac Jun 23 20:27:23 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:24 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-a6a8c944-9031-43ab-abec-480627f4269a req-344dd71e-304d-4e23-81a7-e83a4ba74d3e tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac" returned: 0 in 1.082s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-a6a8c944-9031-43ab-abec-480627f4269a req-344dd71e-304d-4e23-81a7-e83a4ba74d3e tempest-TestStampPattern-1511669606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-a6a8c944-9031-43ab-abec-480627f4269a req-344dd71e-304d-4e23-81a7-e83a4ba74d3e tempest-TestStampPattern-1511669606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-4a276d86-d41a-41ac-9812-87c0157b90ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ac25a12-7c79-4237-85b0-5559316fc8cb', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:27:24 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-a6a8c944-9031-43ab-abec-480627f4269a req-344dd71e-304d-4e23-81a7-e83a4ba74d3e tempest-TestStampPattern-1511669606 None] attachment_update completed successfully. Jun 23 20:27:26 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (db094c89-609f-44c9-a820-35aece66db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:26 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebe2808-9c38-4779-a575-4d9b06f18437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebe2808-9c38-4779-a575-4d9b06f18437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1775639160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0666ca-fbd6-476c-8925-ef2ed71bfd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:27Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6883d612-a765-495a-9324-23fb26cfd971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6883d612-a765-495a-9324-23fb26cfd971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14367010-d007-45d0-b253-460c490fa7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14367010-d007-45d0-b253-460c490fa7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0666ca-fbd6-476c-8925-ef2ed71bfd9a', 'volume_name': 'volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e425aa2-2737-4663-bf15-867e7a8c6a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e425aa2-2737-4663-bf15-867e7a8c6a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a57685f-9cac-4356-8614-a8c2347c323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:27 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume 6e0666ca-fbd6-476c-8925-ef2ed71bfd9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a', 'volume_size': 1} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1775639160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0666ca-fbd6-476c-8925-ef2ed71bfd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:27Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Creating volume 6e0666ca-fbd6-476c-8925-ef2ed71bfd9a {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:27 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:27 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a 1073741824 Jun 23 20:27:27 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:28 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a 1073741824" returned: 0 in 1.064s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:28 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a Jun 23 20:27:28 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Flow 'volume_create_manager' (5567c4c2-8fba-4bc0-b35c-78a441204a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da56d38e-6909-45b2-a039-fb41d284d6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da56d38e-6909-45b2-a039-fb41d284d6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ef4488-4535-4d0f-9ea7-01316fbd2ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ea8c485ad24b97b13a6afa8f8b9933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:29Z,use_quota=True,user_id='ef19e9e7bf5142de96d3273235e68d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab869822-fc8c-49c1-b9b7-267d345deab2),volume_type_id=ab869822-fc8c-49c1-b9b7-267d345deab2)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0056c659-d833-441b-ae1a-3972dfda0d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0056c659-d833-441b-ae1a-3972dfda0d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35a82e2-839d-438d-9c03-9e526c0278c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:28 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:27:29 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a" returned: 0 in 0.877s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a57685f-9cac-4356-8614-a8c2347c323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af99fc3-4000-4fc9-b5b5-5c12088480af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:29 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a (6e0666ca-fbd6-476c-8925-ef2ed71bfd9a): created successfully Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af99fc3-4000-4fc9-b5b5-5c12088480af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (db094c89-609f-44c9-a820-35aece66db62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-dce26f8e-a68c-4f52-86db-50e44db5caff tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created volume successfully. Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35a82e2-839d-438d-9c03-9e526c0278c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '28ef4488-4535-4d0f-9ea7-01316fbd2ab5', 'volume_name': 'volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5', 'volume_size': 1, 'image_id': '50235183-2b90-4032-9cdf-48eb131b67c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50235183-2b90-4032-9cdf-48eb131b67c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '225537e09271b617aa94be985be9b1c2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52ea8c485ad24b97b13a6afa8f8b9933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a11651e7fe08b1dd9499674bffcb3434a0bb057ec5831a4b12d1f89b4ce621028b38b0487e8cc433e79a2ddac9d3f1a2cf50bb788a2a15ced86f21255e01af4', 'id': '50235183-2b90-4032-9cdf-48eb131b67c4', 'created_at': datetime.datetime(2026, 6, 23, 18, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50235183-2b90-4032-9cdf-48eb131b67c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc6dc00-4c47-43ae-91eb-b650002fafd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc6dc00-4c47-43ae-91eb-b650002fafd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3e7c5c-3752-4ca4-bcd0-23c0712d9767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:29 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Volume 28ef4488-4535-4d0f-9ea7-01316fbd2ab5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5', 'volume_size': 1, 'image_id': '50235183-2b90-4032-9cdf-48eb131b67c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50235183-2b90-4032-9cdf-48eb131b67c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '225537e09271b617aa94be985be9b1c2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52ea8c485ad24b97b13a6afa8f8b9933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a11651e7fe08b1dd9499674bffcb3434a0bb057ec5831a4b12d1f89b4ce621028b38b0487e8cc433e79a2ddac9d3f1a2cf50bb788a2a15ced86f21255e01af4', 'id': '50235183-2b90-4032-9cdf-48eb131b67c4', 'created_at': datetime.datetime(2026, 6, 23, 18, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50235183-2b90-4032-9cdf-48eb131b67c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Trying to clone 28ef4488-4535-4d0f-9ea7-01316fbd2ab5 from image 50235183-2b90-4032-9cdf-48eb131b67c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/50235183-2b90-4032-9cdf-48eb131b67c4', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:27:29 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Image download 0.00 MB at 0.00 MB/s Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f6278-afb2-46e5-86f6-93973bc92484]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:29 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD Jun 23 20:27:29 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:30 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD" returned: 0 in 0.815s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:30 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD Jun 23 20:27:30 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (ccbd86ea-94a1-4a1f-83a1-f884f8e42958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df156f9-095e-4e4f-8740-c8bbf9d52c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df156f9-095e-4e4f-8740-c8bbf9d52c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582368981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39ac737-a93a-479e-ab80-c80f7c57106a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:31Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf33b0bd-fcad-4fdf-9c7c-d18d586fe4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf33b0bd-fcad-4fdf-9c7c-d18d586fe4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5709c91b-d3e6-48c8-bf36-a2a133d2a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5709c91b-d3e6-48c8-bf36-a2a133d2a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39ac737-a93a-479e-ab80-c80f7c57106a', 'volume_name': 'volume-e39ac737-a93a-479e-ab80-c80f7c57106a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4bd466-25a0-4902-a516-64c456d0603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4bd466-25a0-4902-a516-64c456d0603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f390414-48d4-437c-83f8-311797f7f34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:30 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume e39ac737-a93a-479e-ab80-c80f7c57106a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39ac737-a93a-479e-ab80-c80f7c57106a', 'volume_size': 1} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582368981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39ac737-a93a-479e-ab80-c80f7c57106a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:31Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Creating volume e39ac737-a93a-479e-ab80-c80f7c57106a {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:31 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:31 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a 1073741824 Jun 23 20:27:31 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (b40fdc1b-418b-4946-84f5-ab554376318e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8260d703-4603-4621-8a30-d7624687868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8260d703-4603-4621-8a30-d7624687868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1727457457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebbac2e-5ca6-43e3-8938-89d177e06162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:31Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec068d2c-479c-492c-aef5-2308b1aa5cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec068d2c-479c-492c-aef5-2308b1aa5cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f3e9a7-7a9e-4a7b-88d3-32d51dbdac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f3e9a7-7a9e-4a7b-88d3-32d51dbdac84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebbac2e-5ca6-43e3-8938-89d177e06162', 'volume_name': 'volume-cebbac2e-5ca6-43e3-8938-89d177e06162', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5653a77b-9338-41f3-9bfa-810295f5dc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5653a77b-9338-41f3-9bfa-810295f5dc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbf3f92-a483-4e08-a0d7-c3b283a9f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:31 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume cebbac2e-5ca6-43e3-8938-89d177e06162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebbac2e-5ca6-43e3-8938-89d177e06162', 'volume_size': 1} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:31 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD" returned: 1 in 1.444s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Temporary image 50235183-2b90-4032-9cdf-48eb131b67c4 is fetched for user ef19e9e7bf5142de96d3273235e68d76. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85e4a11-5a55-4d67-897e-2bb3c556fc0d]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:32 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD Jun 23 20:27:32 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (d0855502-f626-41f0-b0d9-8b0ea5240b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603b596e-7bd6-4953-943f-ff0c34a9ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603b596e-7bd6-4953-943f-ff0c34a9ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1736321029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51cd370-58bf-4046-b4ad-077d87be4d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:32Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dd678c-aca9-4699-b677-98395593d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dd678c-aca9-4699-b677-98395593d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c920fc-37d8-4f55-b520-880ffed470af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c920fc-37d8-4f55-b520-880ffed470af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51cd370-58bf-4046-b4ad-077d87be4d24', 'volume_name': 'volume-c51cd370-58bf-4046-b4ad-077d87be4d24', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50175525-c2ec-4f64-bda1-f267f78e4563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50175525-c2ec-4f64-bda1-f267f78e4563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23f9461-224c-4fa7-bdd6-1a55cab9ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume c51cd370-58bf-4046-b4ad-077d87be4d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51cd370-58bf-4046-b4ad-077d87be4d24', 'volume_size': 1} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:32 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (afb1b75d-b5e6-47db-9467-7316b6d56d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84c7fb8-8e37-4d7e-a19e-0ef277da4990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a 1073741824" returned: 0 in 1.682s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84c7fb8-8e37-4d7e-a19e-0ef277da4990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985536472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a405c5b-7ee9-4a78-81ba-f428921d370d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:33Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e329308-7f19-47ed-8dbd-5dffa2a574df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e329308-7f19-47ed-8dbd-5dffa2a574df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34cce9d5-b3dc-4f48-a020-ffff6edde8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34cce9d5-b3dc-4f48-a020-ffff6edde8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a405c5b-7ee9-4a78-81ba-f428921d370d', 'volume_name': 'volume-7a405c5b-7ee9-4a78-81ba-f428921d370d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835b87c1-8507-400b-9ddb-7fdad57d05aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835b87c1-8507-400b-9ddb-7fdad57d05aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5d6605-ad2e-48b2-9eb4-2146cf960777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:32 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume 7a405c5b-7ee9-4a78-81ba-f428921d370d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a405c5b-7ee9-4a78-81ba-f428921d370d', 'volume_size': 1} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:32 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a Jun 23 20:27:32 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:33 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD" returned: 0 in 1.281s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (ea449e28-d194-4150-b4ad-60e275cddfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5b71c3-fd82-4ca3-9f4d-ab0f839bd994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5b71c3-fd82-4ca3-9f4d-ab0f839bd994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-15397851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b0c175-063f-4b64-9caa-81cdec3f72cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:33Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75056fc6-be48-455b-96b8-714cd1e600c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:33 devstack sudo[109806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD Jun 23 20:27:33 devstack sudo[109806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75056fc6-be48-455b-96b8-714cd1e600c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c17e3ec-865d-436b-88e0-a55ea1594495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c17e3ec-865d-436b-88e0-a55ea1594495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b0c175-063f-4b64-9caa-81cdec3f72cb', 'volume_name': 'volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73290fec-56cc-4aab-b08a-ca41d919ec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73290fec-56cc-4aab-b08a-ca41d919ec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47051f89-6e37-47ee-8695-660ba584819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:33 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume f1b0c175-063f-4b64-9caa-81cdec3f72cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb', 'volume_size': 1} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bd073fd4-9118-4853-928c-a89248667223 tempest-GroupsTest-890830856 None] Group tempest-Group1-2146122947: creating Jun 23 20:27:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bd073fd4-9118-4853-928c-a89248667223 tempest-GroupsTest-890830856 None] Group tempest-Group1-2146122947: created successfully Jun 23 20:27:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bd073fd4-9118-4853-928c-a89248667223 tempest-GroupsTest-890830856 None] Create group completed successfully. Jun 23 20:27:33 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a" returned: 0 in 0.937s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] <== create_volume: return (2731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.735s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.092s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1727457457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebbac2e-5ca6-43e3-8938-89d177e06162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:31Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Creating volume cebbac2e-5ca6-43e3-8938-89d177e06162 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:33 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f390414-48d4-437c-83f8-311797f7f34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39ac737-a93a-479e-ab80-c80f7c57106a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:33 devstack sudo[109809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 1073741824 Jun 23 20:27:33 devstack sudo[109809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75695b50-3eee-4daa-99a9-40864df0ec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:33 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume volume-e39ac737-a93a-479e-ab80-c80f7c57106a (e39ac737-a93a-479e-ab80-c80f7c57106a): created successfully Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75695b50-3eee-4daa-99a9-40864df0ec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (ccbd86ea-94a1-4a1f-83a1-f884f8e42958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-baacf68a-35f7-41b3-8c05-4f8e8be4fdc8 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created volume successfully. Jun 23 20:27:34 devstack sudo[109806]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD" returned: 1 in 0.938s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:27:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:34 devstack sudo[109809]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 1073741824" returned: 0 in 0.886s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:34 devstack sudo[109820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 Jun 23 20:27:34 devstack sudo[109820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-00ce9cfd-c800-443d-962d-c34c0e63a000 tempest-GroupsTest-890830856 None] Group tempest-Group2-1483315047: creating Jun 23 20:27:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-00ce9cfd-c800-443d-962d-c34c0e63a000 tempest-GroupsTest-890830856 None] Group tempest-Group2-1483315047: created successfully Jun 23 20:27:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-00ce9cfd-c800-443d-962d-c34c0e63a000 tempest-GroupsTest-890830856 None] Create group completed successfully. Jun 23 20:27:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-e6682ac3-b086-48b3-8251-3b48ee10dff3 req-1e761c8b-1f31-456e-9a72-689a02575ce9 tempest-TestStampPattern-1511669606 None] Terminate volume connection completed successfully. Jun 23 20:27:34 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-e6682ac3-b086-48b3-8251-3b48ee10dff3 req-1e761c8b-1f31-456e-9a72-689a02575ce9 tempest-TestStampPattern-1511669606 None] Deleting attachment 5ac25a12-7c79-4237-85b0-5559316fc8cb. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:27:35 devstack sudo[109820]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162" returned: 0 in 0.747s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.061s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1736321029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51cd370-58bf-4046-b4ad-077d87be4d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:32Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Creating volume c51cd370-58bf-4046-b4ad-077d87be4d24 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:35 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbf3f92-a483-4e08-a0d7-c3b283a9f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebbac2e-5ca6-43e3-8938-89d177e06162', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff3fd35-045b-4dc0-8c73-805c1c4ad697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:35 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 1073741824 Jun 23 20:27:35 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:35 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume volume-cebbac2e-5ca6-43e3-8938-89d177e06162 (cebbac2e-5ca6-43e3-8938-89d177e06162): created successfully Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff3fd35-045b-4dc0-8c73-805c1c4ad697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (b40fdc1b-418b-4946-84f5-ab554376318e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:35 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7a185d0b-6401-43cf-a085-ddbcffe978be tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created volume successfully. Jun 23 20:27:36 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 1073741824" returned: 0 in 0.981s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:36 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 Jun 23 20:27:36 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Flow 'volume_create_manager' (41efd299-4a9c-49f0-8b9a-6ca80efa9446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460032d8-89cd-4b68-a0ff-f1dcba7274dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460032d8-89cd-4b68-a0ff-f1dcba7274dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-285590183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78307a80-c758-49bb-8c5c-24767935fbf4,host='devstack@QuobyteHD#QuobyteHD',id=beabf931-b324-4906-a3e0-8c7d1bccb13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8025f8bef947a28db64723da76a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:36Z,use_quota=True,user_id='fadb2f73bc44472d85fbb22f2b53c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(170be6ae-a209-480c-903b-6f702b698711),volume_type_id=170be6ae-a209-480c-903b-6f702b698711)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35534ee-4910-40cc-ad69-0202fa50adbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35534ee-4910-40cc-ad69-0202fa50adbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3764249c-1e74-425e-98ad-afb0ba5e95c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3764249c-1e74-425e-98ad-afb0ba5e95c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beabf931-b324-4906-a3e0-8c7d1bccb13d', 'volume_name': 'volume-beabf931-b324-4906-a3e0-8c7d1bccb13d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b96c13-66aa-42c9-8e4c-bc40a0898958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b96c13-66aa-42c9-8e4c-bc40a0898958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86623de8-1d6a-46f7-ad54-89540334bd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Volume beabf931-b324-4906-a3e0-8c7d1bccb13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beabf931-b324-4906-a3e0-8c7d1bccb13d', 'volume_size': 1} Jun 23 20:27:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:37 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24" returned: 0 in 0.691s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.386s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985536472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a405c5b-7ee9-4a78-81ba-f428921d370d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:33Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Creating volume 7a405c5b-7ee9-4a78-81ba-f428921d370d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:37 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23f9461-224c-4fa7-bdd6-1a55cab9ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51cd370-58bf-4046-b4ad-077d87be4d24', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:37 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d 1073741824 Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e03bed2-f5aa-4b88-93c0-603b41af4e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:37 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume volume-c51cd370-58bf-4046-b4ad-077d87be4d24 (c51cd370-58bf-4046-b4ad-077d87be4d24): created successfully Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e03bed2-f5aa-4b88-93c0-603b41af4e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (d0855502-f626-41f0-b0d9-8b0ea5240b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-38815457-60fa-49c8-ace6-c67cc0c7a686 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created volume successfully. Jun 23 20:27:38 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d 1073741824" returned: 0 in 0.918s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:38 devstack sudo[109866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d Jun 23 20:27:38 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:38 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d" returned: 0 in 0.694s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.355s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-15397851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b0c175-063f-4b64-9caa-81cdec3f72cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4618256e29734887acdd2daa103b9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:33Z,use_quota=True,user_id='7ce1fc6a55314999a81a70ae8ca8cbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Creating volume f1b0c175-063f-4b64-9caa-81cdec3f72cb {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:38 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:38 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb 1073741824 Jun 23 20:27:38 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5d6605-ad2e-48b2-9eb4-2146cf960777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a405c5b-7ee9-4a78-81ba-f428921d370d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f676147b-47a3-4143-8141-1a6aca12a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:38 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume volume-7a405c5b-7ee9-4a78-81ba-f428921d370d (7a405c5b-7ee9-4a78-81ba-f428921d370d): created successfully Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f676147b-47a3-4143-8141-1a6aca12a41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (afb1b75d-b5e6-47db-9467-7316b6d56d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:38 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-df000dde-4523-463f-836a-448a8ad1c590 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created volume successfully. Jun 23 20:27:39 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb 1073741824" returned: 0 in 0.863s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:39 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb Jun 23 20:27:39 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:40 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb" returned: 0 in 0.632s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.200s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ef4488-4535-4d0f-9ea7-01316fbd2ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ea8c485ad24b97b13a6afa8f8b9933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:29Z,use_quota=True,user_id='ef19e9e7bf5142de96d3273235e68d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab869822-fc8c-49c1-b9b7-267d345deab2),volume_type_id=ab869822-fc8c-49c1-b9b7-267d345deab2)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Creating volume 28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:40 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47051f89-6e37-47ee-8695-660ba584819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:40 devstack sudo[109878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 1073741824 Jun 23 20:27:40 devstack sudo[109878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9381f16e-c826-4686-b9ed-90fef5f9c303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:40 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Volume volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb (f1b0c175-063f-4b64-9caa-81cdec3f72cb): created successfully Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9381f16e-c826-4686-b9ed-90fef5f9c303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Flow 'volume_create_manager' (ea449e28-d194-4150-b4ad-60e275cddfc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e376bbe6-bc3a-4cd6-b808-7e8f17da20b5 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created volume successfully. Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-f1b0c175-063f-4b64-9caa-81cdec3f72cb-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-f1b0c175-063f-4b64-9caa-81cdec3f72cb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-quobyte-f1b0c175-063f-4b64-9caa-81cdec3f72cb" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-f1b0c175-063f-4b64-9caa-81cdec3f72cb" acquired by "delete_volume" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:41 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cf6f49-aceb-47c1-971a-fc60197fe4cd]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:41 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb Jun 23 20:27:41 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:41 devstack sudo[109878]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 1073741824" returned: 0 in 0.916s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:41 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 Jun 23 20:27:41 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:41 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb" returned: 0 in 0.912s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:41 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb Jun 23 20:27:41 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:42 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" returned: 0 in 0.720s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.401s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78307a80-c758-49bb-8c5c-24767935fbf4,created_at=2026-06-23T18:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-285590183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78307a80-c758-49bb-8c5c-24767935fbf4,host='devstack@QuobyteHD#QuobyteHD',id=beabf931-b324-4906-a3e0-8c7d1bccb13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8025f8bef947a28db64723da76a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:36Z,use_quota=True,user_id='fadb2f73bc44472d85fbb22f2b53c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(170be6ae-a209-480c-903b-6f702b698711),volume_type_id=170be6ae-a209-480c-903b-6f702b698711)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Creating volume beabf931-b324-4906-a3e0-8c7d1bccb13d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:42 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:42 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d 1073741824 Jun 23 20:27:42 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Attempting download of 50235183-2b90-4032-9cdf-48eb131b67c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/50235183-2b90-4032-9cdf-48eb131b67c4', 'metadata': {}}])) to volume 28ef4488-4535-4d0f-9ea7-01316fbd2ab5. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf159bac-c772-404d-9761-5d23e90af4c4]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50235183-2b90-4032-9cdf-48eb131b67c4_sjebmy3b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:42 devstack sudo[109896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50235183-2b90-4032-9cdf-48eb131b67c4_sjebmy3b Jun 23 20:27:42 devstack sudo[109896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:42 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f1b0c175-063f-4b64-9caa-81cdec3f72cb" returned: 0 in 0.802s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-f1b0c175-063f-4b64-9caa-81cdec3f72cb" released by "delete_volume" :: held 1.758s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created reservations ['f7d525a6-6604-4fb8-a601-f40a1edc5333', '6a3b1750-1eec-4a66-bc9f-2ae7cbce8f49', '32681298-5065-4d3d-89ed-e80506ba9383', '1128e23b-90d4-4896-841d-b5dcea265f45'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:43 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d 1073741824" returned: 0 in 0.934s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:43 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:43 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:43 devstack sudo[109896]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:43 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50235183-2b90-4032-9cdf-48eb131b67c4_sjebmy3b" returned: 0 in 0.913s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:43 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50235183-2b90-4032-9cdf-48eb131b67c4_sjebmy3b {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:43 devstack sudo[109908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50235183-2b90-4032-9cdf-48eb131b67c4_sjebmy3b Jun 23 20:27:43 devstack sudo[109908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-7a405c5b-7ee9-4a78-81ba-f428921d370d-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-7a405c5b-7ee9-4a78-81ba-f428921d370d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-quobyte-7a405c5b-7ee9-4a78-81ba-f428921d370d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-7a405c5b-7ee9-4a78-81ba-f428921d370d" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0c1d08-7d38-466a-b073-2c65e0da55f5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:43 devstack sudo[109910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d Jun 23 20:27:43 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:43 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.950s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Deleted volume successfully. Jun 23 20:27:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-683eb0ec-e31f-448f-9960-b6cd627ae204 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-f1b0c175-063f-4b64-9caa-81cdec3f72cb-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:43 devstack sudo[109908]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50235183-2b90-4032-9cdf-48eb131b67c4_sjebmy3b" returned: 1 in 0.917s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50235183-2b90-4032-9cdf-48eb131b67c4_sjebmy3b' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb83b4-6a79-4c9c-855f-2f82362c34cb]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:44 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d" returned: 0 in 1.033s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.067s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86623de8-1d6a-46f7-ad54-89540334bd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beabf931-b324-4906-a3e0-8c7d1bccb13d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bec468c-a719-4e02-8565-33b036278c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:44 devstack sudo[109916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD Jun 23 20:27:44 devstack sudo[109916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Creating offline snapshot d7f3908a-2564-458a-9c0a-4565ebc9e202 of volume 4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:27:44 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Volume volume-beabf931-b324-4906-a3e0-8c7d1bccb13d (beabf931-b324-4906-a3e0-8c7d1bccb13d): created successfully Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bec468c-a719-4e02-8565-33b036278c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Flow 'volume_create_manager' (41efd299-4a9c-49f0-8b9a-6ca80efa9446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6244170-50d9-465b-908d-0322c90c1b0c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:44 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-179ed3b4-17ff-424e-a931-7c6f7ad34a95 tempest-GroupsTest-890830856 None] Created volume successfully. Jun 23 20:27:44 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac Jun 23 20:27:44 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:44 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d" returned: 0 in 0.969s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:44 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d Jun 23 20:27:44 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:44 devstack sudo[109916]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD" returned: 0 in 0.778s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:44 devstack sudo[109928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD Jun 23 20:27:44 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:45 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac" returned: 0 in 0.919s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:45 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 1G Jun 23 20:27:45 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:45 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7a405c5b-7ee9-4a78-81ba-f428921d370d" returned: 0 in 0.731s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-7a405c5b-7ee9-4a78-81ba-f428921d370d" released by "delete_volume" :: held 1.764s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created reservations ['dd57785f-a8dd-48d0-9367-90975682d6ff', 'de664985-6771-4333-8493-c292b8a78613', 'c0683713-27bf-409e-92cc-5b0b3309305d', 'dfb5e774-343d-437b-85ce-c2ebe69d03ec'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:45 devstack sudo[109937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:45 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-c51cd370-58bf-4046-b4ad-077d87be4d24-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-c51cd370-58bf-4046-b4ad-077d87be4d24-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-quobyte-c51cd370-58bf-4046-b4ad-077d87be4d24" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-c51cd370-58bf-4046-b4ad-077d87be4d24" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:45 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD" returned: 1 in 0.950s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] 50235183-2b90-4032-9cdf-48eb131b67c4 was raw, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e8a4c1-5cd6-4dd0-b5b6-50a2c5d8b4dc]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:45 devstack sudo[109942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 Jun 23 20:27:45 devstack sudo[109942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:46 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 Jun 23 20:27:46 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Acquiring lock "cinder-quobyte-beabf931-b324-4906-a3e0-8c7d1bccb13d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Lock "cinder-quobyte-beabf931-b324-4906-a3e0-8c7d1bccb13d" acquired by "delete_volume" :: waited 0.031s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d54d555-ecdc-4f47-8fcb-6930c986d243]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:46 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.874s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:46 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Deleted volume successfully. Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa031341-c1ec-4723-8366-8e6c869f5907 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-7a405c5b-7ee9-4a78-81ba-f428921d370d-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:46 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d Jun 23 20:27:46 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:46 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 1G" returned: 0 in 1.247s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a276d86-d41a-41ac-9812-87c0157b90ac -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:46 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a276d86-d41a-41ac-9812-87c0157b90ac -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 Jun 23 20:27:46 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:46 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:46 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:46 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24" returned: 0 in 1.080s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:46 devstack sudo[109942]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" returned: 0 in 1.122s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_50235183-2b90-4032-9cdf-48eb131b67c4_3pmk436_devstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:27:46 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 20:27:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:46 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24 Jun 23 20:27:46 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:46 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 1G Jun 23 20:27:46 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d" returned: 0 in 1.063s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:47 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:47 devstack sudo[109972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d Jun 23 20:27:47 devstack sudo[109972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:47 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a276d86-d41a-41ac-9812-87c0157b90ac -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202" returned: 0 in 1.027s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:47 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 is being set with open permissions: ugo+rw Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:47 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 Jun 23 20:27:47 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:47 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.041s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:27:47 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c51cd370-58bf-4046-b4ad-077d87be4d24" returned: 0 in 0.931s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-c51cd370-58bf-4046-b4ad-077d87be4d24" released by "delete_volume" :: held 2.085s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=107,cinder:SELECT=94,cinder:DELETE=10,cinder:INSERT=25 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created reservations ['ce35dc7f-9a31-4f86-b2e8-290c601db449', '5849a6d2-db9e-441f-9583-103e19291e31', '7b0af4ea-5a78-4033-b5df-05dac787f375', '9e8683b3-56a6-4689-9b3d-e247faa1929e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:48 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:48 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:48 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 1G" returned: 0 in 1.193s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2326ab-339a-4c6a-b9a0-2b00b144ac7d]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:48 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202" returned: 0 in 0.844s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=120,cinder:SELECT=77,cinder:INSERT=28,cinder:DELETE=9 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:27:48 devstack sudo[109972]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-beabf931-b324-4906-a3e0-8c7d1bccb13d" returned: 0 in 1.043s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:48 devstack sudo[109985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 Jun 23 20:27:48 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Lock "cinder-quobyte-beabf931-b324-4906-a3e0-8c7d1bccb13d" released by "delete_volume" :: held 2.199s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:48 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.info Jun 23 20:27:48 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Created reservations ['e5e0bd8d-c394-431d-9ce8-63e4fddfda19'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:48 devstack cinder-volume[93739]: WARNING cinder.quota [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1793271970 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1793271970, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:27:48 devstack cinder-volume[93739]: WARNING cinder.quota [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1793271970 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1793271970, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Created reservations ['00dd0f24-0b04-4606-898e-ea6bb7907856', '61c6cb03-bfd6-4dcf-b0eb-6e7c65bb6b99', '240a9ab9-a97a-4c30-8409-e534a4ddd5b9', 'efb3bc30-0533-42df-bc21-548f467dfcae'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:48 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:48 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:48 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.798s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:48 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Deleted volume successfully. Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-71dc80b8-1000-4b04-8dd3-9a1d83d80462 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-c51cd370-58bf-4046-b4ad-077d87be4d24-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Created reservations ['8e1b3e47-4b37-4884-86f3-36c10b689322'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:48 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:48 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-cebbac2e-5ca6-43e3-8938-89d177e06162-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-cebbac2e-5ca6-43e3-8938-89d177e06162-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:49 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.info" returned: 0 in 0.912s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:49 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.info is being set with open permissions: ugo+rw Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-quobyte-cebbac2e-5ca6-43e3-8938-89d177e06162" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:49 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.info Jun 23 20:27:49 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-cebbac2e-5ca6-43e3-8938-89d177e06162" acquired by "delete_volume" :: waited 0.033s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:49 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0362880-f31e-4020-92ba-c6a0b2fddf4a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" returned: 0 in 1.158s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:49 devstack sudo[110000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 Jun 23 20:27:49 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:49 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 Jun 23 20:27:49 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:49 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.976s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1e05d216-4d32-4d66-8c2f-bc255b65a939 tempest-GroupsTest-890830856 None] Delete group completed successfully. Jun 23 20:27:49 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.985s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:49 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d0a34a7c-f03c-49da-ab5e-866a28b3eab4 tempest-GroupsTest-890830856 None] Delete group completed successfully. Jun 23 20:27:50 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.info" returned: 0 in 0.903s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.003s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d4503c7c-a789-431e-bd2b-c0a48d688fe1 tempest-TestStampPattern-1511669606 None] Create snapshot completed successfully Jun 23 20:27:50 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" returned: 1 in 0.866s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Downloaded image 50235183-2b90-4032-9cdf-48eb131b67c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/50235183-2b90-4032-9cdf-48eb131b67c4', 'metadata': {}}])) to volume 28ef4488-4535-4d0f-9ea7-01316fbd2ab5 successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Temporary image 50235183-2b90-4032-9cdf-48eb131b67c4 for user ef19e9e7bf5142de96d3273235e68d76 is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Marking volume 28ef4488-4535-4d0f-9ea7-01316fbd2ab5 as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Copying metadata from image 50235183-2b90-4032-9cdf-48eb131b67c4 to 28ef4488-4535-4d0f-9ea7-01316fbd2ab5. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Creating volume glance metadata for volume 28ef4488-4535-4d0f-9ea7-01316fbd2ab5 backed by image 50235183-2b90-4032-9cdf-48eb131b67c4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '50235183-2b90-4032-9cdf-48eb131b67c4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '225537e09271b617aa94be985be9b1c2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3e7c5c-3752-4ca4-bcd0-23c0712d9767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5', 'volume_size': 1, 'image_id': '50235183-2b90-4032-9cdf-48eb131b67c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50235183-2b90-4032-9cdf-48eb131b67c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '225537e09271b617aa94be985be9b1c2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '52ea8c485ad24b97b13a6afa8f8b9933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a11651e7fe08b1dd9499674bffcb3434a0bb057ec5831a4b12d1f89b4ce621028b38b0487e8cc433e79a2ddac9d3f1a2cf50bb788a2a15ced86f21255e01af4', 'id': '50235183-2b90-4032-9cdf-48eb131b67c4', 'created_at': datetime.datetime(2026, 6, 23, 18, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50235183-2b90-4032-9cdf-48eb131b67c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7327a111-b8cd-40b8-9da1-b7919e793a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:50 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Volume volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 (28ef4488-4535-4d0f-9ea7-01316fbd2ab5): created successfully Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7327a111-b8cd-40b8-9da1-b7919e793a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:50 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Flow 'volume_create_manager' (5567c4c2-8fba-4bc0-b35c-78a441204a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162" returned: 0 in 1.022s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d1757fb6-5854-4685-87be-d2b40ed7d54a tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Created volume successfully. Jun 23 20:27:50 devstack sudo[110014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162 Jun 23 20:27:50 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Acquiring lock "cinder-28ef4488-4535-4d0f-9ea7-01316fbd2ab5-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "cinder-28ef4488-4535-4d0f-9ea7-01316fbd2ab5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Acquiring lock "cinder-quobyte-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "cinder-quobyte-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1581cf6c-cfd1-4c0a-b7c6-ecff58ad011b]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-01d381ad-a38d-45a3-900a-d649543e9dd1 tempest-GroupsTest-890830856 None] Group tempest-GroupsTest-Group-2010197411: creating Jun 23 20:27:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-01d381ad-a38d-45a3-900a-d649543e9dd1 tempest-GroupsTest-890830856 None] Group tempest-GroupsTest-Group-2010197411: created successfully Jun 23 20:27:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-01d381ad-a38d-45a3-900a-d649543e9dd1 tempest-GroupsTest-890830856 None] Create group completed successfully. Jun 23 20:27:50 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 Jun 23 20:27:50 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:51 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cebbac2e-5ca6-43e3-8938-89d177e06162" returned: 0 in 0.801s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-cebbac2e-5ca6-43e3-8938-89d177e06162" released by "delete_volume" :: held 1.887s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created reservations ['18557ea4-a889-4e1c-98fd-d1eda049056d', 'c25d45db-6e56-4047-8195-644b9746bec9', '2a6438c1-26f7-4d1d-8484-73f82d9e86fc', 'e0c2c7b5-2981-4b13-a8b1-b67d9ddeb5c2'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:51 devstack sudo[110024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:51 devstack sudo[110024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-e39ac737-a93a-479e-ab80-c80f7c57106a-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-e39ac737-a93a-479e-ab80-c80f7c57106a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-quobyte-e39ac737-a93a-479e-ab80-c80f7c57106a" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-e39ac737-a93a-479e-ab80-c80f7c57106a" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[60523879-de9c-43ec-920c-1637acdbb24b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:51 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" returned: 0 in 0.917s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:51 devstack sudo[110028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a Jun 23 20:27:51 devstack sudo[110028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:51 devstack sudo[110029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 Jun 23 20:27:51 devstack sudo[110029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:52 devstack sudo[110024]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.806s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:52 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Deleted volume successfully. Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-64e52b8f-3efb-4edb-a0be-e4389e0ca513 tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-cebbac2e-5ca6-43e3-8938-89d177e06162-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:52 devstack sudo[110028]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a" returned: 0 in 1.024s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:52 devstack sudo[110029]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:52 devstack sudo[110039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a Jun 23 20:27:52 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Flow 'volume_create_manager' (34b3a7f3-b39b-4f10-a216-a7f40791d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eef82a6-a643-4307-8330-1f04b420a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" returned: 1 in 1.049s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eef82a6-a643-4307-8330-1f04b420a179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349958698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47fb168e-56ac-4dc6-8fb1-09cd56fd05fe,host='devstack@QuobyteHD#QuobyteHD',id=bddc3801-dfdd-499c-8d95-fdd6af186652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8025f8bef947a28db64723da76a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:53Z,use_quota=True,user_id='fadb2f73bc44472d85fbb22f2b53c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c65cc51a-3d4f-45e4-9979-8c466eb7268a),volume_type_id=c65cc51a-3d4f-45e4-9979-8c466eb7268a)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f13fc2-d085-4a17-b186-a42971a010d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f13fc2-d085-4a17-b186-a42971a010d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f479419b-605b-4b95-9ba9-3468543bacb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f479419b-605b-4b95-9ba9-3468543bacb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddc3801-dfdd-499c-8d95-fdd6af186652', 'volume_name': 'volume-bddc3801-dfdd-499c-8d95-fdd6af186652', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:52 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5 Jun 23 20:27:52 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6dfa25-10c0-4374-a651-77640560509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6dfa25-10c0-4374-a651-77640560509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa6d313-e3fe-4e53-bcbc-82d505aaa17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:52 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Volume bddc3801-dfdd-499c-8d95-fdd6af186652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddc3801-dfdd-499c-8d95-fdd6af186652', 'volume_size': 1} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47fb168e-56ac-4dc6-8fb1-09cd56fd05fe,created_at=2026-06-23T18:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349958698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47fb168e-56ac-4dc6-8fb1-09cd56fd05fe,host='devstack@QuobyteHD#QuobyteHD',id=bddc3801-dfdd-499c-8d95-fdd6af186652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8025f8bef947a28db64723da76a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:53Z,use_quota=True,user_id='fadb2f73bc44472d85fbb22f2b53c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c65cc51a-3d4f-45e4-9979-8c466eb7268a),volume_type_id=c65cc51a-3d4f-45e4-9979-8c466eb7268a)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Creating volume bddc3801-dfdd-499c-8d95-fdd6af186652 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:52 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:52 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 1073741824 Jun 23 20:27:52 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:53 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e39ac737-a93a-479e-ab80-c80f7c57106a" returned: 0 in 0.717s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-e39ac737-a93a-479e-ab80-c80f7c57106a" released by "delete_volume" :: held 1.809s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created reservations ['bf6000fa-b560-4a9c-89e4-fc2c2f982bd0', 'edd6ea39-6b6f-40e9-9cca-4acfff45d432', '8a3da03d-4ec0-458a-8517-6a963f576361', 'eefd8ef3-40fd-4e18-ab7b-d1474e78d88e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:53 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" returned: 0 in 0.794s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "cinder-quobyte-28ef4488-4535-4d0f-9ea7-01316fbd2ab5" released by "delete_volume" :: held 2.861s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:53 devstack cinder-volume[93739]: WARNING cinder.quota [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:27:53 devstack cinder-volume[93739]: WARNING cinder.quota [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:27:53 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:53 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Created reservations ['1629890e-15ee-4239-943e-11eb21293926', '076363e8-f37e-42b1-843d-270c0a92986f', '192dbc71-5797-4ad3-a27f-c65f3b7822b7', '33ac6b7d-6748-40d4-becf-89a031d49f80'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:53 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 1073741824" returned: 0 in 0.927s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:53 devstack sudo[110053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:53 devstack sudo[110053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:53 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 Jun 23 20:27:53 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "cinder-quobyte-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a" acquired by "delete_volume" :: waited 0.037s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc0037b-63ae-4f6c-b86d-3ddbdabc450a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:27:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:54 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a Jun 23 20:27:54 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:54 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.950s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Deleted volume successfully. Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-45672a1f-7567-45ce-b2af-be3315b8ae5c tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-e39ac737-a93a-479e-ab80-c80f7c57106a-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:54 devstack sudo[110053]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.989s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Deleted volume successfully. Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-817b3d81-eb1d-45ce-9294-98ac419a5d67 tempest-VolumeAndVolumeTypeFromImageTest-605699532 None] Lock "cinder-28ef4488-4535-4d0f-9ea7-01316fbd2ab5-delete_volume" released by "delete_volume" :: held 4.191s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:54 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652" returned: 0 in 1.050s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa6d313-e3fe-4e53-bcbc-82d505aaa17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddc3801-dfdd-499c-8d95-fdd6af186652', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3a3014-33e4-4a6f-91d1-9f515c0c0009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:54 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Volume volume-bddc3801-dfdd-499c-8d95-fdd6af186652 (bddc3801-dfdd-499c-8d95-fdd6af186652): created successfully Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3a3014-33e4-4a6f-91d1-9f515c0c0009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:54 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Flow 'volume_create_manager' (34b3a7f3-b39b-4f10-a216-a7f40791d876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-11fef47f-12f7-4d30-8131-25090d06bd03 tempest-GroupsTest-890830856 None] Created volume successfully. Jun 23 20:27:55 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a" returned: 0 in 1.159s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:55 devstack sudo[110066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a Jun 23 20:27:55 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:56 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a" returned: 0 in 0.907s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-quobyte-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a" released by "delete_volume" :: held 2.143s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Created reservations ['ca0e6819-2e01-40a1-aeae-54ea32e494b5', 'c37c846d-b0de-4da9-9a26-9a1de28d4915', 'fc2f5c87-f122-4757-a712-de63d3f54655', '90b7b42a-05c4-4b36-85cf-6e53c428fe89'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Flow 'volume_create_manager' (73279500-1bba-473f-bd2f-1d7400434559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6710297a-f9ba-4820-b735-6ccf0cc053ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6710297a-f9ba-4820-b735-6ccf0cc053ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1778053360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47fb168e-56ac-4dc6-8fb1-09cd56fd05fe,host='devstack@QuobyteHD#QuobyteHD',id=ea6671bf-521f-4be9-998b-772ea83d1f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8025f8bef947a28db64723da76a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:56Z,use_quota=True,user_id='fadb2f73bc44472d85fbb22f2b53c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c65cc51a-3d4f-45e4-9979-8c466eb7268a),volume_type_id=c65cc51a-3d4f-45e4-9979-8c466eb7268a)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bd36f8-bcab-43ff-9b98-711c2f715522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bd36f8-bcab-43ff-9b98-711c2f715522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a453479-4123-42bf-99b5-72d3a08a490d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a453479-4123-42bf-99b5-72d3a08a490d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6671bf-521f-4be9-998b-772ea83d1f97', 'volume_name': 'volume-ea6671bf-521f-4be9-998b-772ea83d1f97', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0babf222-2f40-4bfd-b898-ebaa47ae0ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0babf222-2f40-4bfd-b898-ebaa47ae0ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115aeb92-3142-4174-bb0f-bdcfc37031a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:56 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Volume ea6671bf-521f-4be9-998b-772ea83d1f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6671bf-521f-4be9-998b-772ea83d1f97', 'volume_size': 1} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47fb168e-56ac-4dc6-8fb1-09cd56fd05fe,created_at=2026-06-23T18:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1778053360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47fb168e-56ac-4dc6-8fb1-09cd56fd05fe,host='devstack@QuobyteHD#QuobyteHD',id=ea6671bf-521f-4be9-998b-772ea83d1f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8025f8bef947a28db64723da76a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:27:56Z,use_quota=True,user_id='fadb2f73bc44472d85fbb22f2b53c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c65cc51a-3d4f-45e4-9979-8c466eb7268a),volume_type_id=c65cc51a-3d4f-45e4-9979-8c466eb7268a)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Creating volume ea6671bf-521f-4be9-998b-772ea83d1f97 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:27:56 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:27:56 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 1073741824 Jun 23 20:27:56 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:56 devstack sudo[110109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:27:56 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:57 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.887s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:57 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:27:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Deleted volume successfully. Jun 23 20:27:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8507ce77-b709-4540-adb6-b17fe3c7636f tempest-CreateVolumesFromSourceVolumeTest-1735623527 None] Lock "cinder-6e0666ca-fbd6-476c-8925-ef2ed71bfd9a-delete_volume" released by "delete_volume" :: held 3.635s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:27:57 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 1073741824" returned: 0 in 1.306s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:27:57 devstack sudo[110126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 Jun 23 20:27:57 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:27:58 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root Jun 23 20:27:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97" returned: 0 in 0.923s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:27:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:27:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:27:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115aeb92-3142-4174-bb0f-bdcfc37031a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6671bf-521f-4be9-998b-772ea83d1f97', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f60082-2724-48f2-bb33-362165bb8507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:27:58 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Volume volume-ea6671bf-521f-4be9-998b-772ea83d1f97 (ea6671bf-521f-4be9-998b-772ea83d1f97): created successfully Jun 23 20:27:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f60082-2724-48f2-bb33-362165bb8507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:27:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Flow 'volume_create_manager' (73279500-1bba-473f-bd2f-1d7400434559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:27:58 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-63935521-03b4-45d6-bc3f-be5002aec93c tempest-GroupsTest-890830856 None] Created volume successfully. Jun 23 20:28:00 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3aca1a0d-1a37-48a0-bdc5-9ef9dc3ba438 tempest-GroupsTest-890830856 None] Update group completed successfully. Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Flow 'volume_create_manager' (935bf519-4dd8-4bd9-8fea-d782c9a75c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495c6871-f264-42c4-b74d-ff4ea3ee73dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495c6871-f264-42c4-b74d-ff4ea3ee73dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a034a9c4-818c-4902-887b-63ad200b8913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686df344304340b58bb1cee67a9f6ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:01Z,use_quota=True,user_id='55e67c18cb89499cbbac7fc71d5ae3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3158a7-0cb6-45e8-8e62-c3418948ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3158a7-0cb6-45e8-8e62-c3418948ba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65362ed-23ae-4701-b471-1da30be34a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65362ed-23ae-4701-b471-1da30be34a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a034a9c4-818c-4902-887b-63ad200b8913', 'volume_name': 'volume-a034a9c4-818c-4902-887b-63ad200b8913', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c9fc6a-b10e-4d8c-a929-39a1ef5c9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c9fc6a-b10e-4d8c-a929-39a1ef5c9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad21525-b9c5-4a84-8d1b-aba7a1e66c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:00 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Volume a034a9c4-818c-4902-887b-63ad200b8913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a034a9c4-818c-4902-887b-63ad200b8913', 'volume_size': 1} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a034a9c4-818c-4902-887b-63ad200b8913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686df344304340b58bb1cee67a9f6ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:01Z,use_quota=True,user_id='55e67c18cb89499cbbac7fc71d5ae3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Creating volume a034a9c4-818c-4902-887b-63ad200b8913 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:28:00 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:28:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:00 devstack sudo[110129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 1073741824 Jun 23 20:28:00 devstack sudo[110129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Flow 'volume_create_manager' (e1f36c09-b323-49c2-a113-616dd9642e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4d2ad9-e084-4294-8934-7599cb71fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4d2ad9-e084-4294-8934-7599cb71fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1514098817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a534280b-2533-4d8e-a91e-4837a2998f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e085d74a0fd438a8db0d44b3e31e98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:01Z,use_quota=True,user_id='5d5f18d5026a443e9376c9426de5acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d6ea36-3a89-4b2f-b698-52daca9903ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d6ea36-3a89-4b2f-b698-52daca9903ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0bfc3c-05e4-4da3-a023-9d20baffd55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0bfc3c-05e4-4da3-a023-9d20baffd55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a534280b-2533-4d8e-a91e-4837a2998f4d', 'volume_name': 'volume-a534280b-2533-4d8e-a91e-4837a2998f4d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404c6b5d-cc5a-432e-b56e-5f4c5ba426b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404c6b5d-cc5a-432e-b56e-5f4c5ba426b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043f73e7-4aca-44c2-a520-0aeb76f2d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:01 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Volume a534280b-2533-4d8e-a91e-4837a2998f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a534280b-2533-4d8e-a91e-4837a2998f4d', 'volume_size': 1} Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-88669f0e-a99c-45cf-9c04-37650fbc5621 tempest-GroupsTest-890830856 None] Update group completed successfully. Jun 23 20:28:01 devstack sudo[110129]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 1073741824" returned: 0 in 1.237s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:02 devstack sudo[110135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 Jun 23 20:28:02 devstack sudo[110135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:02 devstack sudo[110135]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913" returned: 0 in 0.690s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1514098817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a534280b-2533-4d8e-a91e-4837a2998f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e085d74a0fd438a8db0d44b3e31e98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:01Z,use_quota=True,user_id='5d5f18d5026a443e9376c9426de5acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Creating volume a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:28:02 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:02 devstack sudo[110138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d 1073741824 Jun 23 20:28:02 devstack sudo[110138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad21525-b9c5-4a84-8d1b-aba7a1e66c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a034a9c4-818c-4902-887b-63ad200b8913', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2924b0f9-6ee4-45e2-a044-a53c31a88f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:02 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Volume volume-a034a9c4-818c-4902-887b-63ad200b8913 (a034a9c4-818c-4902-887b-63ad200b8913): created successfully Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2924b0f9-6ee4-45e2-a044-a53c31a88f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Flow 'volume_create_manager' (935bf519-4dd8-4bd9-8fea-d782c9a75c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-93bbf0bf-ee8d-401c-bcd0-43ef7d5a8be1 tempest-CinderUnicodeTest-555416074 None] Created volume successfully. Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Flow 'volume_create_manager' (1359fc7d-edc9-436c-baa5-6138a2c622cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f40924-f6a1-4723-b452-665c5732e777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f40924-f6a1-4723-b452-665c5732e777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-73639679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be7b123-a984-4804-91bf-afa57604b793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bc7a2c68b54d81b176c7e36fb9ccbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7f3908a-2564-458a-9c0a-4565ebc9e202,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:03Z,use_quota=True,user_id='fd58a0a0dd5e45e28a7395ea7db3b7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba168981-7e76-4f08-ad47-a852fe57b0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba168981-7e76-4f08-ad47-a852fe57b0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e555ed79-93d1-42b5-a8bd-8da5ee6fe66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e555ed79-93d1-42b5-a8bd-8da5ee6fe66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4be7b123-a984-4804-91bf-afa57604b793', 'volume_name': 'volume-4be7b123-a984-4804-91bf-afa57604b793', 'volume_size': 1, 'snapshot_id': 'd7f3908a-2564-458a-9c0a-4565ebc9e202'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77c2d03-1a2c-4a9b-8245-9e18c034edb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77c2d03-1a2c-4a9b-8245-9e18c034edb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ed2efe-06d7-4379-adf3-164f72706f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:03 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Volume 4be7b123-a984-4804-91bf-afa57604b793: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4be7b123-a984-4804-91bf-afa57604b793', 'volume_size': 1, 'snapshot_id': 'd7f3908a-2564-458a-9c0a-4565ebc9e202'} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Acquiring lock "cinder-quobyte-bddc3801-dfdd-499c-8d95-fdd6af186652" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Lock "cinder-quobyte-bddc3801-dfdd-499c-8d95-fdd6af186652" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:03 devstack sudo[110138]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d 1073741824" returned: 0 in 1.145s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc91ce31-ba3b-4921-82ad-61a1745c8f58]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:03 devstack sudo[110144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d Jun 23 20:28:03 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:04 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 Jun 23 20:28:04 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Flow 'volume_create_manager' (554e5b90-2675-4423-b833-b4050be9e206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cade96-7922-48c6-b331-4951b5703653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cade96-7922-48c6-b331-4951b5703653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-347946008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdebe3c-709d-48c3-816e-2992bdc5f987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686df344304340b58bb1cee67a9f6ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:05Z,use_quota=True,user_id='55e67c18cb89499cbbac7fc71d5ae3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773f334b-eecc-44e3-a8e1-c04618e44830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773f334b-eecc-44e3-a8e1-c04618e44830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9376a4e9-ddd6-4603-a55a-741338c2220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9376a4e9-ddd6-4603-a55a-741338c2220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cdebe3c-709d-48c3-816e-2992bdc5f987', 'volume_name': 'volume-4cdebe3c-709d-48c3-816e-2992bdc5f987', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fab30a-5f1b-423e-9def-9a19c4b9e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fab30a-5f1b-423e-9def-9a19c4b9e958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d47ed63-9c85-4f01-a6a3-824b9397a790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:04 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Volume 4cdebe3c-709d-48c3-816e-2992bdc5f987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cdebe3c-709d-48c3-816e-2992bdc5f987', 'volume_size': 1} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:04 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d" returned: 0 in 0.837s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.126s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-quobyte-d7f3908a-2564-458a-9c0a-4565ebc9e202-4be7b123-a984-4804-91bf-afa57604b793" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043f73e7-4aca-44c2-a520-0aeb76f2d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a534280b-2533-4d8e-a91e-4837a2998f4d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5d0bf2-f01b-447a-8796-15c8604acf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-d7f3908a-2564-458a-9c0a-4565ebc9e202-4be7b123-a984-4804-91bf-afa57604b793" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Creating volume 4be7b123-a984-4804-91bf-afa57604b793 from snapshot d7f3908a-2564-458a-9c0a-4565ebc9e202 {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-quobyte-4be7b123-a984-4804-91bf-afa57604b793" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-4be7b123-a984-4804-91bf-afa57604b793" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] snapshot: d7f3908a-2564-458a-9c0a-4565ebc9e202, volume: 4be7b123-a984-4804-91bf-afa57604b793, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:28:04 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Volume volume-a534280b-2533-4d8e-a91e-4837a2998f4d (a534280b-2533-4d8e-a91e-4837a2998f4d): created successfully Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5d0bf2-f01b-447a-8796-15c8604acf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Flow 'volume_create_manager' (e1f36c09-b323-49c2-a113-616dd9642e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:04 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-85214f7a-50a3-4e53-aa91-7e1c08284f40 tempest-VolumeDependencyTests-440780623 None] Created volume successfully. Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8b866d-a429-4d7d-8b22-3c6469105c11]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:05 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652" returned: 0 in 1.131s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:05 devstack sudo[110157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652 Jun 23 20:28:05 devstack sudo[110157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:05 devstack sudo[110156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 Jun 23 20:28:05 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:05 devstack sudo[110157]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-bddc3801-dfdd-499c-8d95-fdd6af186652" returned: 0 in 0.731s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Lock "cinder-quobyte-bddc3801-dfdd-499c-8d95-fdd6af186652" released by "delete_volume" :: held 1.936s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Acquiring lock "cinder-quobyte-ea6671bf-521f-4be9-998b-772ea83d1f97" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Lock "cinder-quobyte-ea6671bf-521f-4be9-998b-772ea83d1f97" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[682c9c38-c3a3-47ed-a70b-071a5083f458]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:05 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202" returned: 0 in 0.980s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a276d86-d41a-41ac-9812-87c0157b90ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4283c3b6-9f92-43f8-b07c-01957d6273d5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:05 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 Jun 23 20:28:05 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:06 devstack sudo[110166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac Jun 23 20:28:06 devstack sudo[110166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:06 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97" returned: 0 in 0.948s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:06 devstack sudo[110174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97 Jun 23 20:28:06 devstack sudo[110174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:06 devstack sudo[110166]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac" returned: 0 in 0.876s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:06 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:28:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:06 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 Jun 23 20:28:06 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:07 devstack sudo[110174]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-ea6671bf-521f-4be9-998b-772ea83d1f97" returned: 0 in 0.843s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Lock "cinder-quobyte-ea6671bf-521f-4be9-998b-772ea83d1f97" released by "delete_volume" :: held 1.848s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:07 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Created reservations ['7a09f1de-2fb6-4fb7-8dc1-ae62b77cf322'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:07 devstack cinder-volume[93739]: WARNING cinder.quota [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1393326781 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1393326781, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:28:07 devstack cinder-volume[93739]: WARNING cinder.quota [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1393326781 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1393326781, it is now deprecated. Please use the default quota class for default quota. Jun 23 20:28:07 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Created reservations ['076538d4-80c1-47bb-ad01-c4a8e5b558d5', 'b445c7bb-292b-4cb2-86cc-b5ce2d4a008c', '1d989b54-139e-4acc-8814-b08b27756710', 'c2171ae8-7bb8-4152-9715-b71da6e92ec8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:07 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Created reservations ['dec2bc2f-53f3-4c26-89bb-326e244a8274', '2da79351-6daa-48d8-ab2a-d561b49169e5', 'c2434f80-ded2-4777-9141-6ef2e7e15795', '9102c03d-1426-41b7-940e-f5e679574e1c'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:08 devstack sudo[110190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:28:08 devstack sudo[110190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:09 devstack sudo[110190]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.629s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:09 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:28:09 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0629752b-ffa1-4413-8232-c88640945bf6 tempest-GroupsTest-890830856 None] Delete group completed successfully. Jun 23 20:28:13 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793" returned: 0 in 6.878s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:13 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18d5360-38b8-4001-b47d-0690fa4b2e26]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:13 devstack sudo[110193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac Jun 23 20:28:13 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:15 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac" returned: 0 in 1.442s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:15 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:28:15 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Converted 1024.00 MB image at 148.86 MB/s Jun 23 20:28:15 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 is being set with open permissions: ugo+rw Jun 23 20:28:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:15 devstack sudo[110202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 Jun 23 20:28:15 devstack sudo[110202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:16 devstack sudo[110202]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793" returned: 0 in 0.997s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-4be7b123-a984-4804-91bf-afa57604b793" released by "_copy_volume_from_snapshot" :: held 11.349s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-d7f3908a-2564-458a-9c0a-4565ebc9e202-4be7b123-a984-4804-91bf-afa57604b793" released by "_create_volume_from_snapshot" :: held 11.396s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.446s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.467s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-347946008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdebe3c-709d-48c3-816e-2992bdc5f987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686df344304340b58bb1cee67a9f6ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:05Z,use_quota=True,user_id='55e67c18cb89499cbbac7fc71d5ae3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Creating volume 4cdebe3c-709d-48c3-816e-2992bdc5f987 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:28:16 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:16 devstack sudo[110225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 1073741824 Jun 23 20:28:16 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ed2efe-06d7-4379-adf3-164f72706f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be7b123-a984-4804-91bf-afa57604b793', 'volume_size': 1, 'snapshot_id': 'd7f3908a-2564-458a-9c0a-4565ebc9e202'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaceabbf-9de5-4301-9180-56f4e475e771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:16 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Volume volume-4be7b123-a984-4804-91bf-afa57604b793 (4be7b123-a984-4804-91bf-afa57604b793): created successfully Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaceabbf-9de5-4301-9180-56f4e475e771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Flow 'volume_create_manager' (1359fc7d-edc9-436c-baa5-6138a2c622cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:16 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d1a7a0f4-d33f-4c37-98bf-b2ceb69da08b tempest-TestStampPattern-1511669606 None] Created volume successfully. Jun 23 20:28:17 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 1073741824" returned: 0 in 1.158s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:17 devstack sudo[110233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 Jun 23 20:28:17 devstack sudo[110233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:18 devstack sudo[110233]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987" returned: 0 in 0.670s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.200s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d47ed63-9c85-4f01-a6a3-824b9397a790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cdebe3c-709d-48c3-816e-2992bdc5f987', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f7de23-99a7-491d-b0f9-d36f4abc3943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Creating offline snapshot e0d9f286-5e3a-4483-9c09-9720b0c58bd3 of volume a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:28:18 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Volume volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 (4cdebe3c-709d-48c3-816e-2992bdc5f987): created successfully Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f7de23-99a7-491d-b0f9-d36f4abc3943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Flow 'volume_create_manager' (554e5b90-2675-4423-b833-b4050be9e206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fc858b-4f4c-48e3-90a3-d682205e1496]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-325d8b53-1d22-4c68-9616-85fef6e8eb94 tempest-CinderUnicodeTest-555416074 None] Created volume successfully. Jun 23 20:28:18 devstack sudo[110236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d Jun 23 20:28:18 devstack sudo[110236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:19 devstack sudo[110236]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d" returned: 0 in 0.854s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:19 devstack sudo[110241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 1G Jun 23 20:28:19 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Flow 'volume_create_manager' (d6ea0167-28d7-406b-a54d-06316401cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409895fc-9066-4066-b6d0-6281791c7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409895fc-9066-4066-b6d0-6281791c7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-175275692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e557e9-49ae-49dc-b254-303e3143ca0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc86292d3fac4ee690fab5bf7c6cb5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:19Z,use_quota=True,user_id='d736559729404d3e9e21ffdc7d3fdadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321eb0b9-3797-4744-8f82-e752afc25d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321eb0b9-3797-4744-8f82-e752afc25d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f262fbcb-6764-4a10-ad9f-8c610f8f45eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f262fbcb-6764-4a10-ad9f-8c610f8f45eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e557e9-49ae-49dc-b254-303e3143ca0c', 'volume_name': 'volume-f2e557e9-49ae-49dc-b254-303e3143ca0c', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425bf5ac-8970-45ac-8973-c3923e61e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425bf5ac-8970-45ac-8973-c3923e61e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be99aa0b-5d86-42f9-a4dd-d4b90a47c994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:19 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Volume f2e557e9-49ae-49dc-b254-303e3143ca0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e557e9-49ae-49dc-b254-303e3143ca0c', 'volume_size': 1} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:20 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 1G" returned: 0 in 0.940s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a534280b-2533-4d8e-a91e-4837a2998f4d -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:20 devstack sudo[110250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a534280b-2533-4d8e-a91e-4837a2998f4d -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 Jun 23 20:28:20 devstack sudo[110250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:20 devstack sudo[110250]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a534280b-2533-4d8e-a91e-4837a2998f4d -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3" returned: 0 in 0.655s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:20 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 is being set with open permissions: ugo+rw Jun 23 20:28:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:20 devstack sudo[110255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 Jun 23 20:28:20 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:21 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3" returned: 0 in 0.659s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:21 devstack sudo[110273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.info Jun 23 20:28:21 devstack sudo[110273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:22 devstack sudo[110273]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.info" returned: 0 in 0.819s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:22 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.info is being set with open permissions: ugo+rw Jun 23 20:28:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:22 devstack sudo[110321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.info Jun 23 20:28:22 devstack sudo[110321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:23 devstack sudo[110321]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.info" returned: 0 in 0.957s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.058s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.612s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-175275692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e557e9-49ae-49dc-b254-303e3143ca0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc86292d3fac4ee690fab5bf7c6cb5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:19Z,use_quota=True,user_id='d736559729404d3e9e21ffdc7d3fdadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Creating volume f2e557e9-49ae-49dc-b254-303e3143ca0c {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:28:23 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:28:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:23 devstack sudo[110334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c 1073741824 Jun 23 20:28:23 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:23 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-31457720-5e72-45d4-81ad-4d3cbdaa335c tempest-VolumeDependencyTests-440780623 None] Create snapshot completed successfully Jun 23 20:28:24 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c 1073741824" returned: 0 in 0.914s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:24 devstack sudo[110342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c Jun 23 20:28:24 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:24 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:28:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Flow 'volume_create_manager' (9fe2e57b-9a74-4851-a699-cb70a8ddcb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e9bb2c-4a1e-4b02-accf-8ea09a3df26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e9bb2c-4a1e-4b02-accf-8ea09a3df26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-374303352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf7d21a-1fc5-4a12-b71e-1c9773db90f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e085d74a0fd438a8db0d44b3e31e98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0d9f286-5e3a-4483-9c09-9720b0c58bd3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:25Z,use_quota=True,user_id='5d5f18d5026a443e9376c9426de5acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9056b3d8-0dd7-4dd7-84e7-c12e5f4adc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9056b3d8-0dd7-4dd7-84e7-c12e5f4adc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0095069b-d023-4b51-a301-6e372da58a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0095069b-d023-4b51-a301-6e372da58a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'acf7d21a-1fc5-4a12-b71e-1c9773db90f9', 'volume_name': 'volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9', 'volume_size': 1, 'snapshot_id': 'e0d9f286-5e3a-4483-9c09-9720b0c58bd3'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb2d933-a15c-40aa-bdf4-3228e9102708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb2d933-a15c-40aa-bdf4-3228e9102708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b93df19-7abb-4a23-8054-17f957717c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:25 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Volume acf7d21a-1fc5-4a12-b71e-1c9773db90f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9', 'volume_size': 1, 'snapshot_id': 'e0d9f286-5e3a-4483-9c09-9720b0c58bd3'} Jun 23 20:28:25 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c" returned: 0 in 0.884s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.454s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Creating offline snapshot c007570a-9266-4a5c-8257-637ef27d887d of volume 4cdebe3c-709d-48c3-816e-2992bdc5f987 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be99aa0b-5d86-42f9-a4dd-d4b90a47c994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e557e9-49ae-49dc-b254-303e3143ca0c', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4919d867-af1f-4bf7-84bb-28d0d71af589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebec9eb2-81c8-40e9-81b2-7d62a5d67586]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:25 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Volume volume-f2e557e9-49ae-49dc-b254-303e3143ca0c (f2e557e9-49ae-49dc-b254-303e3143ca0c): created successfully Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4919d867-af1f-4bf7-84bb-28d0d71af589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:25 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Flow 'volume_create_manager' (d6ea0167-28d7-406b-a54d-06316401cf70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8e0a5bd9-0b68-4fe2-8639-3d10348c2b0f tempest-VolumesServicesTestJSON-453678978 None] Created volume successfully. Jun 23 20:28:25 devstack sudo[110346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 Jun 23 20:28:25 devstack sudo[110346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:26 devstack sudo[110346]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987" returned: 0 in 0.996s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:26 devstack sudo[110351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d 1G Jun 23 20:28:26 devstack sudo[110351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Acquiring lock "cinder-f2e557e9-49ae-49dc-b254-303e3143ca0c-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Lock "cinder-f2e557e9-49ae-49dc-b254-303e3143ca0c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Acquiring lock "cinder-quobyte-f2e557e9-49ae-49dc-b254-303e3143ca0c" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Lock "cinder-quobyte-f2e557e9-49ae-49dc-b254-303e3143ca0c" acquired by "delete_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:26 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[da339246-8bfc-4d62-8000-234c89b7a9b6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:26 devstack sudo[110353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c Jun 23 20:28:26 devstack sudo[110353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:27 devstack sudo[110353]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c" returned: 0 in 1.025s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:27 devstack sudo[110397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c Jun 23 20:28:27 devstack sudo[110397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:27 devstack sudo[110351]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d 1G" returned: 0 in 1.429s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:27 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d Jun 23 20:28:27 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:28 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d" returned: 0 in 0.966s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:28 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d is being set with open permissions: ugo+rw Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:28 devstack sudo[110409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d Jun 23 20:28:28 devstack sudo[110409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:28 devstack sudo[110397]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-f2e557e9-49ae-49dc-b254-303e3143ca0c" returned: 0 in 1.092s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Lock "cinder-quobyte-f2e557e9-49ae-49dc-b254-303e3143ca0c" released by "delete_volume" :: held 2.196s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Created reservations ['c4cec7c9-fef7-4181-acad-201cd1158dbb', '2ad2125c-c51c-49ba-ab56-9f957ec08c50', '1a637540-86e0-4310-b698-441dbc5d1f0a', '66935a16-747a-42f3-b27a-9364768a8d4e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:28 devstack sudo[110412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:28:28 devstack sudo[110412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:29 devstack sudo[110409]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d" returned: 0 in 0.912s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:29 devstack sudo[110415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.info Jun 23 20:28:29 devstack sudo[110415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:29 devstack sudo[110412]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.801s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:29 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:28:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Deleted volume successfully. Jun 23 20:28:29 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-40546630-e43a-481e-8e53-4a5d5530358d tempest-VolumesServicesTestJSON-453678978 None] Lock "cinder-f2e557e9-49ae-49dc-b254-303e3143ca0c-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:30 devstack sudo[110415]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.info" returned: 0 in 0.802s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:30 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.info is being set with open permissions: ugo+rw Jun 23 20:28:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:30 devstack sudo[110419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.info Jun 23 20:28:30 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:31 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.info" returned: 0 in 0.748s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.980s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.988s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-quobyte-e0d9f286-5e3a-4483-9c09-9720b0c58bd3-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-e0d9f286-5e3a-4483-9c09-9720b0c58bd3-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Creating volume acf7d21a-1fc5-4a12-b71e-1c9773db90f9 from snapshot e0d9f286-5e3a-4483-9c09-9720b0c58bd3 {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-quobyte-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:31 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-429ac076-8db8-4aac-bfaa-10f744e8d052 tempest-CinderUnicodeTest-555416074 None] Create snapshot completed successfully Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] snapshot: e0d9f286-5e3a-4483-9c09-9720b0c58bd3, volume: acf7d21a-1fc5-4a12-b71e-1c9773db90f9, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b247af-6348-4688-ba4a-c89de691bfc7]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:31 devstack sudo[110422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 Jun 23 20:28:31 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:32 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3" returned: 0 in 0.904s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a534280b-2533-4d8e-a91e-4837a2998f4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[327815f9-6ba1-4a67-a74d-33bf7eae5c8d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "cinder-c007570a-9266-4a5c-8257-637ef27d887d-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-c007570a-9266-4a5c-8257-637ef27d887d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "cinder-quobyte-4cdebe3c-709d-48c3-816e-2992bdc5f987" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:32 devstack sudo[110427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-quobyte-4cdebe3c-709d-48c3-816e-2992bdc5f987" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "cinder-quobyte-c007570a-9266-4a5c-8257-637ef27d887d" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:32 devstack sudo[110427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-quobyte-c007570a-9266-4a5c-8257-637ef27d887d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Deleting offline snapshot c007570a-9266-4a5c-8257-637ef27d887d of volume 4cdebe3c-709d-48c3-816e-2992bdc5f987 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] snapshot_file for this snap is: volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d24895-ffd2-4e6c-ac6d-80ef719ce582]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:32 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d Jun 23 20:28:32 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:33 devstack sudo[110427]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d" returned: 0 in 1.183s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:33 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:28:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:33 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 Jun 23 20:28:33 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:33 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d" returned: 0 in 1.231s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cdebe3c-709d-48c3-816e-2992bdc5f987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:28:33 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d4a671-7329-4d33-998b-1a8556f29c4c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:33 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 Jun 23 20:28:33 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:35 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987" returned: 0 in 1.826s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:35 devstack sudo[110457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d Jun 23 20:28:35 devstack sudo[110457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:38 devstack sudo[110457]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d" returned: 0 in 2.452s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:38 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d Jun 23 20:28:38 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:39 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987.c007570a-9266-4a5c-8257-637ef27d887d" returned: 0 in 1.854s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-quobyte-c007570a-9266-4a5c-8257-637ef27d887d" released by "_delete_snapshot" :: held 7.543s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-quobyte-4cdebe3c-709d-48c3-816e-2992bdc5f987" released by "delete_snapshot" :: held 7.580s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:40 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Created reservations ['bb895572-ac40-4b58-a422-74a252f80e69', '185c7801-c6b3-4359-97ab-161632d262f5', 'c6167100-8c59-4b61-ae45-0240c62cb89e', '08df0636-390f-406d-8b9e-9bc190e44a44'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:40 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" returned: 0 in 6.729s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:40 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3029663-3342-4b8a-830e-6b89b01b8f15]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Delete snapshot completed successfully. Jun 23 20:28:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e30dd5cb-9856-4560-8965-fc24d6cb13c5 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-c007570a-9266-4a5c-8257-637ef27d887d-delete_snapshot" released by "delete_snapshot" :: held 7.818s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:40 devstack sudo[110479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d Jun 23 20:28:40 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:41 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d" returned: 0 in 1.067s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:28:41 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Converted 1024.00 MB image at 152.16 MB/s Jun 23 20:28:41 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 is being set with open permissions: ugo+rw Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:41 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 Jun 23 20:28:41 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "cinder-4cdebe3c-709d-48c3-816e-2992bdc5f987-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-4cdebe3c-709d-48c3-816e-2992bdc5f987-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "cinder-quobyte-4cdebe3c-709d-48c3-816e-2992bdc5f987" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-quobyte-4cdebe3c-709d-48c3-816e-2992bdc5f987" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73381f-e089-458d-8137-00fdf66da03c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:41 devstack sudo[110487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 Jun 23 20:28:41 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:41 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" returned: 0 in 0.778s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" released by "_copy_volume_from_snapshot" :: held 10.811s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-e0d9f286-5e3a-4483-9c09-9720b0c58bd3-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" released by "_create_volume_from_snapshot" :: held 10.872s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.905s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b93df19-7abb-4a23-8054-17f957717c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9', 'volume_size': 1, 'snapshot_id': 'e0d9f286-5e3a-4483-9c09-9720b0c58bd3'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa18e541-655c-4a6b-9d76-fa9817f0770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:42 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Volume volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 (acf7d21a-1fc5-4a12-b71e-1c9773db90f9): created successfully Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa18e541-655c-4a6b-9d76-fa9817f0770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Flow 'volume_create_manager' (9fe2e57b-9a74-4851-a699-cb70a8ddcb9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b2d9475d-d0df-436d-8d20-c32c9403314b tempest-VolumeDependencyTests-440780623 None] Created volume successfully. Jun 23 20:28:42 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987" returned: 0 in 0.903s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:42 devstack sudo[110493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987 Jun 23 20:28:42 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-e0d9f286-5e3a-4483-9c09-9720b0c58bd3-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-e0d9f286-5e3a-4483-9c09-9720b0c58bd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-quobyte-a534280b-2533-4d8e-a91e-4837a2998f4d" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-a534280b-2533-4d8e-a91e-4837a2998f4d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-quobyte-e0d9f286-5e3a-4483-9c09-9720b0c58bd3" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-e0d9f286-5e3a-4483-9c09-9720b0c58bd3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Deleting offline snapshot e0d9f286-5e3a-4483-9c09-9720b0c58bd3 of volume a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] snapshot_file for this snap is: volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b177b47-8749-421b-8e42-2236f5503a62]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:43 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4cdebe3c-709d-48c3-816e-2992bdc5f987" returned: 0 in 0.798s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-quobyte-4cdebe3c-709d-48c3-816e-2992bdc5f987" released by "delete_volume" :: held 1.798s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Created reservations ['1b7a5b47-5312-4a51-83db-3a392390508f', '68d73045-bd94-4fa2-ad99-02f805921a36', '5afa275b-8588-4ea6-b0e3-cc1626799fe2', 'cdcd9831-777d-4031-a872-3ab57d756637'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:43 devstack sudo[110496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 Jun 23 20:28:43 devstack sudo[110496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:43 devstack sudo[110498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:28:43 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "cinder-a034a9c4-818c-4902-887b-63ad200b8913-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-a034a9c4-818c-4902-887b-63ad200b8913-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "cinder-quobyte-a034a9c4-818c-4902-887b-63ad200b8913" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-quobyte-a034a9c4-818c-4902-887b-63ad200b8913" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fd047b-e66e-45a2-a775-acc34433e5bd]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:43 devstack sudo[110500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 Jun 23 20:28:43 devstack sudo[110500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:44 devstack sudo[110496]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3" returned: 0 in 0.975s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a534280b-2533-4d8e-a91e-4837a2998f4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3ee3cc-b012-4c56-a494-db7cfff02610]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:44 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.849s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:28:44 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Deleted volume successfully. Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1e48d484-b250-4586-91ff-6ee094179a52 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-4cdebe3c-709d-48c3-816e-2992bdc5f987-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:44 devstack sudo[110506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d Jun 23 20:28:44 devstack sudo[110506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:44 devstack sudo[110500]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913" returned: 0 in 0.911s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:44 devstack sudo[110512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913 Jun 23 20:28:44 devstack sudo[110512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:45 devstack sudo[110506]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d" returned: 0 in 0.960s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:45 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 Jun 23 20:28:45 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:45 devstack sudo[110512]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a034a9c4-818c-4902-887b-63ad200b8913" returned: 0 in 0.716s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-quobyte-a034a9c4-818c-4902-887b-63ad200b8913" released by "delete_volume" :: held 1.684s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Created reservations ['fad7cc38-fe5d-4255-bb84-f528311f4334', '657d4748-276d-416a-ab01-071a66e535e9', '8a3c7022-92a9-4ad5-891a-82bb23357454', 'f065fdc0-c5da-4ad6-aab7-17496013992e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:45 devstack sudo[110520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:28:45 devstack sudo[110520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:45 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3" returned: 0 in 0.924s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:46 devstack sudo[110525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3 Jun 23 20:28:46 devstack sudo[110525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:46 devstack sudo[110520]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.816s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:28:46 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Deleted volume successfully. Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-6ea853c4-bd49-42e0-bd86-8cd89c26e195 tempest-CinderUnicodeTest-555416074 None] Lock "cinder-a034a9c4-818c-4902-887b-63ad200b8913-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:46 devstack sudo[110528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:28:46 devstack sudo[110528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:46 devstack sudo[110525]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d.e0d9f286-5e3a-4483-9c09-9720b0c58bd3" returned: 0 in 1.029s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-e0d9f286-5e3a-4483-9c09-9720b0c58bd3" released by "_delete_snapshot" :: held 4.047s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-a534280b-2533-4d8e-a91e-4837a2998f4d" released by "delete_snapshot" :: held 4.074s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Created reservations ['8e204159-f31d-40f4-879e-bac0bb49c1c2', '8bd9af2d-668e-4639-9f96-cd595cc00113', 'c059cdbb-7e6a-446b-a6db-c8b6c1d48c8d', '284e4968-2724-437f-8216-7f71bf45e8d4'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:47 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Delete snapshot completed successfully. Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-11ff5cf4-17bc-465a-b958-6c424938b71e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-e0d9f286-5e3a-4483-9c09-9720b0c58bd3-delete_snapshot" released by "delete_snapshot" :: held 4.349s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:47 devstack sudo[110528]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.940s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:28:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:28:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-a534280b-2533-4d8e-a91e-4837a2998f4d-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Lock "cinder-a534280b-2533-4d8e-a91e-4837a2998f4d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:48 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=138,cinder:SELECT=121,cinder:INSERT=34,cinder:DELETE=10 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:28:48 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=129,cinder:INSERT=35,cinder:SELECT=99,cinder:DELETE=10 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:28:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-quobyte-a534280b-2533-4d8e-a91e-4837a2998f4d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-a534280b-2533-4d8e-a91e-4837a2998f4d" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:48 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790dad5-bbee-4647-a3d2-a84ebaafe230]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:48 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d Jun 23 20:28:48 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:49 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d" returned: 0 in 1.043s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:49 devstack sudo[110538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d Jun 23 20:28:49 devstack sudo[110538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:50 devstack sudo[110538]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a534280b-2533-4d8e-a91e-4837a2998f4d" returned: 0 in 0.974s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-a534280b-2533-4d8e-a91e-4837a2998f4d" released by "delete_volume" :: held 2.138s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Created reservations ['c38b7aa1-6754-4bf0-90e4-dfb0bbb4ec29', 'efa68e16-ac7f-4df1-b70a-ad0f81f5c801', '99bd2087-2943-4bc9-946a-300edab8afca', '159cd27c-4911-405d-94c2-64eb962187c8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:50 devstack sudo[110547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:28:50 devstack sudo[110547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-acf7d21a-1fc5-4a12-b71e-1c9773db90f9-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-acf7d21a-1fc5-4a12-b71e-1c9773db90f9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:51 devstack sudo[110547]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.075s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:51 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:28:51 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Deleted volume successfully. Jun 23 20:28:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c08553b0-e5ba-4bdf-b261-56010767c0ee tempest-VolumeDependencyTests-440780623 None] Lock "cinder-a534280b-2533-4d8e-a91e-4837a2998f4d-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Acquiring lock "cinder-quobyte-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:28:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:28:52 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b19f204-3ed8-4c55-951c-3a12e7adf201]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:52 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 Jun 23 20:28:52 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:53 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" returned: 0 in 1.035s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:53 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9 Jun 23 20:28:53 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:53 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" returned: 0 in 0.700s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-quobyte-acf7d21a-1fc5-4a12-b71e-1c9773db90f9" released by "delete_volume" :: held 1.799s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Created reservations ['e6d9c47e-d513-412d-b499-2b9319e9e197', '9276da5c-8cf4-40f7-98d9-a75accc2a751', '4001f00e-9386-4dd4-9e52-834e32599291', '5d76b790-838c-453a-8cb2-59057d2c123b'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:54 devstack sudo[110558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:28:54 devstack sudo[110558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:54 devstack sudo[110558]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.785s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:54 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:28:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Deleted volume successfully. Jun 23 20:28:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e66d8589-8ab1-4ab8-8d54-d559d12d0e7e tempest-VolumeDependencyTests-440780623 None] Lock "cinder-acf7d21a-1fc5-4a12-b71e-1c9773db90f9-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:28:55 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:28:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Flow 'volume_create_manager' (fd757734-8b06-4976-a4d5-012b3c079020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d6c8f0-01bf-4df5-ae8c-061950fba682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d6c8f0-01bf-4df5-ae8c-061950fba682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1401736984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351f1ea3-57a6-4015-8f5a-ecb2bd81278c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbab3b951c3540baba0ab7ecfb1b010e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:56Z,use_quota=True,user_id='dea0244075814d10b2ab6a90c0e63a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61ed140-5457-480b-aa3e-957d68ddc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61ed140-5457-480b-aa3e-957d68ddc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2520089-a8da-4306-9ea3-2baa8fcfce91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2520089-a8da-4306-9ea3-2baa8fcfce91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351f1ea3-57a6-4015-8f5a-ecb2bd81278c', 'volume_name': 'volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdecd41-42f4-4604-bf88-0727f89a551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdecd41-42f4-4604-bf88-0727f89a551c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517dfced-232a-44ec-ad6a-ad9fd0e240ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:56 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Volume 351f1ea3-57a6-4015-8f5a-ecb2bd81278c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c', 'volume_size': 1} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1401736984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351f1ea3-57a6-4015-8f5a-ecb2bd81278c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbab3b951c3540baba0ab7ecfb1b010e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:28:56Z,use_quota=True,user_id='dea0244075814d10b2ab6a90c0e63a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Creating volume 351f1ea3-57a6-4015-8f5a-ecb2bd81278c {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:28:56 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:28:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:56 devstack sudo[110562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c 1073741824 Jun 23 20:28:56 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:57 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c 1073741824" returned: 0 in 1.360s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:57 devstack sudo[110569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c Jun 23 20:28:57 devstack sudo[110569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:28:58 devstack sudo[110569]: pam_unix(sudo:session): session closed for user root Jun 23 20:28:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" returned: 0 in 0.882s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:28:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:28:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.306s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:28:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517dfced-232a-44ec-ad6a-ad9fd0e240ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f8008d-6229-4645-a62a-59a8ba82d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:28:58 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Volume volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c (351f1ea3-57a6-4015-8f5a-ecb2bd81278c): created successfully Jun 23 20:28:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f8008d-6229-4645-a62a-59a8ba82d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:28:58 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Flow 'volume_create_manager' (fd757734-8b06-4976-a4d5-012b3c079020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:28:58 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-6184dc60-6626-4914-85aa-f0573070202b tempest-SnapshotMetadataTestJSON-652054624 None] Created volume successfully. Jun 23 20:28:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:28:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:28:59 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Creating offline snapshot c4a8b717-49ae-4640-9b51-f2f9512f9d95 of volume 351f1ea3-57a6-4015-8f5a-ecb2bd81278c {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:28:59 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c430beee-981b-4756-b430-046c3252bf44]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:28:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:28:59 devstack sudo[110572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c Jun 23 20:28:59 devstack sudo[110572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:00 devstack sudo[110572]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" returned: 0 in 0.851s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:00 devstack sudo[110577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 1G Jun 23 20:29:00 devstack sudo[110577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:01 devstack sudo[110577]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 1G" returned: 0 in 0.884s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:01 devstack sudo[110583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 Jun 23 20:29:01 devstack sudo[110583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:01 devstack sudo[110583]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95" returned: 0 in 0.786s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:01 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 is being set with open permissions: ugo+rw Jun 23 20:29:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:01 devstack sudo[110589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 Jun 23 20:29:01 devstack sudo[110589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:02 devstack sudo[110589]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95" returned: 0 in 0.712s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:02 devstack sudo[110592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.info Jun 23 20:29:02 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:03 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.info" returned: 0 in 0.696s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:03 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.info is being set with open permissions: ugo+rw Jun 23 20:29:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:03 devstack sudo[110595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.info Jun 23 20:29:03 devstack sudo[110595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:04 devstack sudo[110595]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.info" returned: 0 in 0.680s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.728s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:04 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8aa2446f-f1ae-4d74-b3a2-924a028a765f tempest-SnapshotMetadataTestJSON-652054624 None] Create snapshot completed successfully Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "cinder-c4a8b717-49ae-4640-9b51-f2f9512f9d95-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-c4a8b717-49ae-4640-9b51-f2f9512f9d95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "cinder-quobyte-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-quobyte-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "cinder-quobyte-c4a8b717-49ae-4640-9b51-f2f9512f9d95" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-quobyte-c4a8b717-49ae-4640-9b51-f2f9512f9d95" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Deleting offline snapshot c4a8b717-49ae-4640-9b51-f2f9512f9d95 of volume 351f1ea3-57a6-4015-8f5a-ecb2bd81278c {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] snapshot_file for this snap is: volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e389b1-4ca2-484e-b504-a575c04b636c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:05 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 Jun 23 20:29:05 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:06 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95" returned: 0 in 0.994s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:29:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ece4f3-0e27-4739-b21c-a63016788c7c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:06 devstack sudo[110613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c Jun 23 20:29:06 devstack sudo[110613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:07 devstack sudo[110613]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" returned: 0 in 0.861s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:07 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 Jun 23 20:29:07 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-731e754b-58ce-4995-add2-ea155f9eb300 req-816e6d2e-2145-4d80-a96c-f1f0dd7e7df1 tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-731e754b-58ce-4995-add2-ea155f9eb300 req-816e6d2e-2145-4d80-a96c-f1f0dd7e7df1 tempest-TestStampPattern-1511669606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:08 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[38faed98-22dc-48aa-affc-8594fe1c3073]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-731e754b-58ce-4995-add2-ea155f9eb300 req-816e6d2e-2145-4d80-a96c-f1f0dd7e7df1 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:08 devstack sudo[110630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 Jun 23 20:29:08 devstack sudo[110630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:08 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95" returned: 0 in 1.022s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:08 devstack sudo[110634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95 Jun 23 20:29:08 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:09 devstack sudo[110630]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-731e754b-58ce-4995-add2-ea155f9eb300 req-816e6d2e-2145-4d80-a96c-f1f0dd7e7df1 tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793" returned: 0 in 1.030s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-731e754b-58ce-4995-add2-ea155f9eb300 req-816e6d2e-2145-4d80-a96c-f1f0dd7e7df1 tempest-TestStampPattern-1511669606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.057s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-731e754b-58ce-4995-add2-ea155f9eb300 req-816e6d2e-2145-4d80-a96c-f1f0dd7e7df1 tempest-TestStampPattern-1511669606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-4be7b123-a984-4804-91bf-afa57604b793', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '225b50ca-9a99-4cea-bfbf-836c68c373d0', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:29:09 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-731e754b-58ce-4995-add2-ea155f9eb300 req-816e6d2e-2145-4d80-a96c-f1f0dd7e7df1 tempest-TestStampPattern-1511669606 None] attachment_update completed successfully. Jun 23 20:29:09 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c.c4a8b717-49ae-4640-9b51-f2f9512f9d95" returned: 0 in 0.893s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-quobyte-c4a8b717-49ae-4640-9b51-f2f9512f9d95" released by "_delete_snapshot" :: held 3.905s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-quobyte-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" released by "delete_snapshot" :: held 3.936s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Created reservations ['b93d6e02-1dc5-4ffb-b6bc-47effb4674db', 'fa158f93-4dce-4ce1-84a9-403a0416bf77', 'f1a264dd-2181-4128-8be0-73c749fe4e71', 'dccff88c-f7f8-4aee-b0f5-4defdef554ce'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:09 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Delete snapshot completed successfully. Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0ebd4ed9-4549-4064-a503-c082f5b122cb tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-c4a8b717-49ae-4640-9b51-f2f9512f9d95-delete_snapshot" released by "delete_snapshot" :: held 4.087s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "cinder-351f1ea3-57a6-4015-8f5a-ecb2bd81278c-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-351f1ea3-57a6-4015-8f5a-ecb2bd81278c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "cinder-quobyte-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-quobyte-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" acquired by "delete_volume" :: waited 0.035s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[de422870-7092-433a-818b-27e87fa6f628]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:10 devstack sudo[110707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c Jun 23 20:29:10 devstack sudo[110707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:10 devstack sudo[110707]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" returned: 0 in 0.832s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:10 devstack sudo[111031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c Jun 23 20:29:10 devstack sudo[111031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:11 devstack sudo[111031]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" returned: 0 in 0.752s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-quobyte-351f1ea3-57a6-4015-8f5a-ecb2bd81278c" released by "delete_volume" :: held 1.679s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Created reservations ['64c48cff-f1db-4e41-95cb-324f3e0e11fb', '050a4c62-419f-4ffe-8950-e4ca28ccacf9', 'f3288543-80ec-470f-9a45-468982bcb7be', 'f5468448-e9a7-413d-856c-825193cec369'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:11 devstack sudo[111034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:11 devstack sudo[111034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:12 devstack sudo[111034]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.925s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:12 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:12 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Deleted volume successfully. Jun 23 20:29:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-625b3768-9d8b-460d-9881-6eea95142ac7 tempest-SnapshotMetadataTestJSON-652054624 None] Lock "cinder-351f1ea3-57a6-4015-8f5a-ecb2bd81278c-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Flow 'volume_create_manager' (a20baa06-6b62-4912-93a3-438458ed68fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a9be52-92e1-4927-b5dd-aa67c1c9184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a9be52-92e1-4927-b5dd-aa67c1c9184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-796956622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1db3964-2667-4753-8103-9c2be00a1908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654e78f742d64b8f8dd8ba13654e6cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:14Z,use_quota=True,user_id='e679a397c724425b837bcd3029491e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaaafa5-0f95-4f77-b9d5-e55904946723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaaafa5-0f95-4f77-b9d5-e55904946723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a024c7-fa07-4469-a044-bb029311e04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a024c7-fa07-4469-a044-bb029311e04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1db3964-2667-4753-8103-9c2be00a1908', 'volume_name': 'volume-c1db3964-2667-4753-8103-9c2be00a1908', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bf93fa-6d01-4b59-895c-afa42c4883b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bf93fa-6d01-4b59-895c-afa42c4883b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b022ee66-5662-4763-95e9-b9a3976505a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:14 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Volume c1db3964-2667-4753-8103-9c2be00a1908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1db3964-2667-4753-8103-9c2be00a1908', 'volume_size': 1} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-796956622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1db3964-2667-4753-8103-9c2be00a1908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654e78f742d64b8f8dd8ba13654e6cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:14Z,use_quota=True,user_id='e679a397c724425b837bcd3029491e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Creating volume c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:29:14 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:29:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:14 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 1073741824 Jun 23 20:29:14 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:15 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 1073741824" returned: 0 in 1.034s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:15 devstack sudo[111060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 Jun 23 20:29:15 devstack sudo[111060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:15 devstack sudo[111060]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908" returned: 0 in 0.746s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b022ee66-5662-4763-95e9-b9a3976505a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1db3964-2667-4753-8103-9c2be00a1908', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30721ae-759d-4c26-b0f2-1845bf3c6b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Volume volume-c1db3964-2667-4753-8103-9c2be00a1908 (c1db3964-2667-4753-8103-9c2be00a1908): created successfully Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30721ae-759d-4c26-b0f2-1845bf3c6b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Flow 'volume_create_manager' (a20baa06-6b62-4912-93a3-438458ed68fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-55bb6cbb-9cb2-44ec-84fb-1a6a1c6c3465 tempest-SnapshotDependencyTests-607537574 None] Created volume successfully. Jun 23 20:29:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Creating offline snapshot 41b12d0a-0bc2-428a-ae71-afd164764c34 of volume c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:29:16 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb265ed-c20a-47c6-963a-202e3aa7e9d7]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:16 devstack sudo[111063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 Jun 23 20:29:16 devstack sudo[111063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:17 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-4d557cf8-3512-4964-a12a-61ae697ddf63 req-60d2f41a-5a19-4670-b551-1a907a04024e tempest-TestStampPattern-1511669606 None] Terminate volume connection completed successfully. Jun 23 20:29:17 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-4d557cf8-3512-4964-a12a-61ae697ddf63 req-60d2f41a-5a19-4670-b551-1a907a04024e tempest-TestStampPattern-1511669606 None] Deleting attachment 225b50ca-9a99-4cea-bfbf-836c68c373d0. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:29:17 devstack sudo[111063]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908" returned: 0 in 0.957s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:17 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 1G Jun 23 20:29:17 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:18 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 1G" returned: 0 in 0.908s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1db3964-2667-4753-8103-9c2be00a1908 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:18 devstack sudo[111106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1db3964-2667-4753-8103-9c2be00a1908 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 Jun 23 20:29:18 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:19 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1db3964-2667-4753-8103-9c2be00a1908 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34" returned: 0 in 0.857s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:19 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 is being set with open permissions: ugo+rw Jun 23 20:29:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:19 devstack sudo[111112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 Jun 23 20:29:19 devstack sudo[111112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:19 devstack sudo[111112]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34" returned: 0 in 0.893s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:20 devstack sudo[111118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.info Jun 23 20:29:20 devstack sudo[111118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Flow 'volume_create_manager' (f3af99c8-ccf6-4fc1-ba9e-6e30c4316ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9f4dea-7834-4f84-a752-7f0aa809f346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9f4dea-7834-4f84-a752-7f0aa809f346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-280517940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9a033a2afd436c8539b91b486107a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:21Z,use_quota=True,user_id='ac0cf6f5f40246e88d11dcd280c36218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83687db-0c5b-40b9-8acc-d234c5433d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83687db-0c5b-40b9-8acc-d234c5433d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f69bcd-c925-42f9-9712-da216daf41ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f69bcd-c925-42f9-9712-da216daf41ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b8dd0b-5d34-4082-8b51-0b7b50caf6ce', 'volume_name': 'volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ba2436-af00-437f-bc9b-c591dfc57ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ba2436-af00-437f-bc9b-c591dfc57ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194660d4-1fe6-4275-8a1d-679b692cc3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:20 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Volume d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce', 'volume_size': 1} Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:20 devstack sudo[111118]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.info" returned: 0 in 0.882s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:20 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.info is being set with open permissions: ugo+rw Jun 23 20:29:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:20 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.info Jun 23 20:29:20 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:21 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.info" returned: 0 in 0.939s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.567s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-280517940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9a033a2afd436c8539b91b486107a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:21Z,use_quota=True,user_id='ac0cf6f5f40246e88d11dcd280c36218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Creating volume d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:29:21 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:29:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:21 devstack sudo[111161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce 1073741824 Jun 23 20:29:21 devstack sudo[111161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-04334ac5-8139-4e5a-80fd-fcd11b60ae74 tempest-SnapshotDependencyTests-607537574 None] Create snapshot completed successfully Jun 23 20:29:22 devstack sudo[111161]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce 1073741824" returned: 0 in 0.959s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:22 devstack sudo[111170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce Jun 23 20:29:22 devstack sudo[111170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Flow 'volume_create_manager' (ede3abee-97c3-4b36-8694-a5c47ff87166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671b6d65-afcc-4848-8832-2184dccf80af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671b6d65-afcc-4848-8832-2184dccf80af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e430fe19-1f4b-4a8d-9d02-aa3b45f97c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654e78f742d64b8f8dd8ba13654e6cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41b12d0a-0bc2-428a-ae71-afd164764c34,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:23Z,use_quota=True,user_id='e679a397c724425b837bcd3029491e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e079b47-0b7e-4d2a-960c-64055f7b3881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e079b47-0b7e-4d2a-960c-64055f7b3881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f031dbbc-9764-4f7a-a33e-1164a7b3fd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f031dbbc-9764-4f7a-a33e-1164a7b3fd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e430fe19-1f4b-4a8d-9d02-aa3b45f97c40', 'volume_name': 'volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40', 'volume_size': 1, 'snapshot_id': '41b12d0a-0bc2-428a-ae71-afd164764c34'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2436ec77-d619-4ab5-9a1b-93484fed006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2436ec77-d619-4ab5-9a1b-93484fed006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10914fc-f916-4fa3-8ddd-df9369d65c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:23 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Volume e430fe19-1f4b-4a8d-9d02-aa3b45f97c40: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40', 'volume_size': 1, 'snapshot_id': '41b12d0a-0bc2-428a-ae71-afd164764c34'} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:23 devstack sudo[111170]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce" returned: 0 in 0.869s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.162s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-quobyte-41b12d0a-0bc2-428a-ae71-afd164764c34-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194660d4-1fe6-4275-8a1d-679b692cc3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa04bde-4fc3-4bee-b350-3ccc4fe7346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-41b12d0a-0bc2-428a-ae71-afd164764c34-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Creating volume e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 from snapshot 41b12d0a-0bc2-428a-ae71-afd164764c34 {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-quobyte-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:23 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Volume volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce (d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce): created successfully Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa04bde-4fc3-4bee-b350-3ccc4fe7346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Flow 'volume_create_manager' (f3af99c8-ccf6-4fc1-ba9e-6e30c4316ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] snapshot: 41b12d0a-0bc2-428a-ae71-afd164764c34, volume: e430fe19-1f4b-4a8d-9d02-aa3b45f97c40, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:23 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c3832478-94e3-4681-abeb-c85df32d8e25 tempest-VolumesTransfersTest-1569901296 None] Created volume successfully. Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a779a-64b3-4b54-9376-4119c82a51dd]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:24 devstack sudo[111183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 Jun 23 20:29:24 devstack sudo[111183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:24 devstack sudo[111183]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34" returned: 0 in 0.894s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1db3964-2667-4753-8103-9c2be00a1908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:29:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:29:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:29:24 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb40f4b-7aa5-402e-a9f2-ed4b7f61c962]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:24 devstack sudo[111189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 Jun 23 20:29:24 devstack sudo[111189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:25 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-947547b0-5866-4e08-a412-f405ec37bd2e tempest-VolumesTransfersTest-1478816392 None] Transfer volume completed successfully. Jun 23 20:29:25 devstack sudo[111189]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908" returned: 0 in 0.896s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:25 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:29:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:25 devstack sudo[111194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 Jun 23 20:29:25 devstack sudo[111194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Acquiring lock "cinder-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Lock "cinder-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Acquiring lock "cinder-quobyte-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Lock "cinder-quobyte-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:26 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3486d3de-e0cf-411c-8a39-84d10c846415]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:26 devstack sudo[111200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce Jun 23 20:29:26 devstack sudo[111200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-4be7b123-a984-4804-91bf-afa57604b793-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Lock "cinder-4be7b123-a984-4804-91bf-afa57604b793-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-quobyte-4be7b123-a984-4804-91bf-afa57604b793" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-4be7b123-a984-4804-91bf-afa57604b793" acquired by "delete_volume" :: waited 0.060s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c80da14-8be2-46c3-a5a3-1d393b71461d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:28 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 Jun 23 20:29:28 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:28 devstack sudo[111200]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce" returned: 0 in 2.089s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:28 devstack sudo[111248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce Jun 23 20:29:28 devstack sudo[111248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:30 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793" returned: 0 in 1.808s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:30 devstack sudo[111255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793 Jun 23 20:29:30 devstack sudo[111255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:30 devstack sudo[111248]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce" returned: 0 in 2.283s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Lock "cinder-quobyte-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce" released by "delete_volume" :: held 4.473s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Created reservations ['33dc5e43-4ed9-41a0-a760-a69778aa5dcc', 'e02f40cf-59d7-4e3d-9dd8-6a5110e05079', 'b4334c97-eadb-446e-b329-9608bea49df4', '36e86858-8ec9-42c6-b1d4-4ebc3e8cda38'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:31 devstack sudo[111258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:31 devstack sudo[111258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:31 devstack sudo[111255]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4be7b123-a984-4804-91bf-afa57604b793" returned: 0 in 1.688s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-4be7b123-a984-4804-91bf-afa57604b793" released by "delete_volume" :: held 3.601s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:31 devstack sudo[111194]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" returned: 0 in 6.147s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aa3409-1bd0-4f9a-a6d8-f196c9ac0e5a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:31 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Created reservations ['338a5dad-e42a-4108-9d92-6da6942b3852', 'c09b2492-9c17-45a5-9e10-9433ee6ddad4', '74736832-e007-4c1b-9e1c-87c41231b467', '022a5799-cf52-43aa-a7bb-c377ff8fe7bd'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:31 devstack sudo[111261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 Jun 23 20:29:31 devstack sudo[111261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:32 devstack sudo[111263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:32 devstack sudo[111263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:32 devstack sudo[111258]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.839s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Deleted volume successfully. Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2c9b4a0d-2cd0-4e96-8760-cf51a9ff3520 tempest-VolumesTransfersTest-22465053 None] Lock "cinder-d4b8dd0b-5d34-4082-8b51-0b7b50caf6ce-delete_volume" released by "delete_volume" :: held 5.904s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:32 devstack sudo[111263]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.737s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Deleted volume successfully. Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9dc58a60-9a8b-4e8b-ace8-49d858b0faaa tempest-TestStampPattern-1511669606 None] Lock "cinder-4be7b123-a984-4804-91bf-afa57604b793-delete_volume" released by "delete_volume" :: held 4.809s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:32 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Flow 'volume_create_manager' (bf2f87b8-5ac8-4225-9055-4da5a6cafcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f942807-021a-47a3-9172-2f287e034f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f942807-021a-47a3-9172-2f287e034f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1924562349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a686530-caad-4781-94cf-402c8896fe8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9a033a2afd436c8539b91b486107a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:33Z,use_quota=True,user_id='ac0cf6f5f40246e88d11dcd280c36218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1046972-0602-4d87-8444-38e5bc39c130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1046972-0602-4d87-8444-38e5bc39c130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d5a3ae-71f7-480a-918a-a7de82cfc79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d5a3ae-71f7-480a-918a-a7de82cfc79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a686530-caad-4781-94cf-402c8896fe8d', 'volume_name': 'volume-2a686530-caad-4781-94cf-402c8896fe8d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:33 devstack sudo[111261]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab4faf2-63df-49b5-af63-66302cde9187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab4faf2-63df-49b5-af63-66302cde9187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ca2b10-11a7-484b-9499-1ead05798514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:33 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Volume 2a686530-caad-4781-94cf-402c8896fe8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a686530-caad-4781-94cf-402c8896fe8d', 'volume_size': 1} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908" returned: 0 in 1.216s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:29:33 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Converted 1024.00 MB image at 166.55 MB/s Jun 23 20:29:33 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 is being set with open permissions: ugo+rw Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:33 devstack sudo[111270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 Jun 23 20:29:33 devstack sudo[111270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-d7f3908a-2564-458a-9c0a-4565ebc9e202-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Lock "cinder-d7f3908a-2564-458a-9c0a-4565ebc9e202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-quobyte-4a276d86-d41a-41ac-9812-87c0157b90ac" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-4a276d86-d41a-41ac-9812-87c0157b90ac" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-quobyte-d7f3908a-2564-458a-9c0a-4565ebc9e202" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-d7f3908a-2564-458a-9c0a-4565ebc9e202" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Deleting offline snapshot d7f3908a-2564-458a-9c0a-4565ebc9e202 of volume 4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] snapshot_file for this snap is: volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3198aea-0937-412d-946d-6317f6fa99d6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:33 devstack sudo[111272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 Jun 23 20:29:33 devstack sudo[111272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:33 devstack sudo[111270]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" returned: 0 in 0.693s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" released by "_copy_volume_from_snapshot" :: held 9.971s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-41b12d0a-0bc2-428a-ae71-afd164764c34-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" released by "_create_volume_from_snapshot" :: held 10.017s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.046s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.726s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1924562349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a686530-caad-4781-94cf-402c8896fe8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9a033a2afd436c8539b91b486107a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:33Z,use_quota=True,user_id='ac0cf6f5f40246e88d11dcd280c36218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Creating volume 2a686530-caad-4781-94cf-402c8896fe8d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:29:33 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:33 devstack sudo[111275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d 1073741824 Jun 23 20:29:33 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10914fc-f916-4fa3-8ddd-df9369d65c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40', 'volume_size': 1, 'snapshot_id': '41b12d0a-0bc2-428a-ae71-afd164764c34'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a7673e-0495-43b7-a780-27d59f579b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:33 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Volume volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 (e430fe19-1f4b-4a8d-9d02-aa3b45f97c40): created successfully Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a7673e-0495-43b7-a780-27d59f579b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:33 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Flow 'volume_create_manager' (ede3abee-97c3-4b36-8694-a5c47ff87166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:33 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-daa957f7-5881-4da7-ac90-1a9dd1f8769c tempest-SnapshotDependencyTests-607537574 None] Created volume successfully. Jun 23 20:29:34 devstack sudo[111272]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202" returned: 0 in 0.811s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a276d86-d41a-41ac-9812-87c0157b90ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cffb437-ac45-4b9f-83da-abfc46d12056]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:34 devstack sudo[111280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac Jun 23 20:29:34 devstack sudo[111280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-41b12d0a-0bc2-428a-ae71-afd164764c34-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-41b12d0a-0bc2-428a-ae71-afd164764c34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-quobyte-c1db3964-2667-4753-8103-9c2be00a1908" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-c1db3964-2667-4753-8103-9c2be00a1908" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-quobyte-41b12d0a-0bc2-428a-ae71-afd164764c34" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-41b12d0a-0bc2-428a-ae71-afd164764c34" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Deleting offline snapshot 41b12d0a-0bc2-428a-ae71-afd164764c34 of volume c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] snapshot_file for this snap is: volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c7b0ca-5483-4c09-abb8-8c4ada549399]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:34 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d 1073741824" returned: 0 in 1.023s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:34 devstack sudo[111288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 Jun 23 20:29:34 devstack sudo[111288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:34 devstack sudo[111292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d Jun 23 20:29:34 devstack sudo[111292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:34 devstack sudo[111280]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac" returned: 0 in 0.825s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:34 devstack sudo[111295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 Jun 23 20:29:34 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:35 devstack sudo[111292]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d" returned: 0 in 0.661s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ca2b10-11a7-484b-9499-1ead05798514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a686530-caad-4781-94cf-402c8896fe8d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df2fb1d-0c6e-4254-a733-631c76475b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:35 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Volume volume-2a686530-caad-4781-94cf-402c8896fe8d (2a686530-caad-4781-94cf-402c8896fe8d): created successfully Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df2fb1d-0c6e-4254-a733-631c76475b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Flow 'volume_create_manager' (bf2f87b8-5ac8-4225-9055-4da5a6cafcd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:35 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-eb583368-4b6d-41f0-b828-48d914be9c90 tempest-VolumesTransfersTest-1569901296 None] Created volume successfully. Jun 23 20:29:35 devstack sudo[111288]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34" returned: 0 in 0.947s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1db3964-2667-4753-8103-9c2be00a1908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa05cff5-37d3-416a-acf5-27b34b3511db]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:35 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202" returned: 0 in 0.815s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:35 devstack sudo[111306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202 Jun 23 20:29:35 devstack sudo[111306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:35 devstack sudo[111305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 Jun 23 20:29:35 devstack sudo[111305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Acquiring lock "cinder-2a686530-caad-4781-94cf-402c8896fe8d-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Lock "cinder-2a686530-caad-4781-94cf-402c8896fe8d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Acquiring lock "cinder-quobyte-2a686530-caad-4781-94cf-402c8896fe8d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Lock "cinder-quobyte-2a686530-caad-4781-94cf-402c8896fe8d" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff7a83b-1fd1-459a-9167-87dda012b54e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:36 devstack sudo[111306]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac.d7f3908a-2564-458a-9c0a-4565ebc9e202" returned: 0 in 0.802s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:36 devstack sudo[111305]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908" returned: 0 in 0.860s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-d7f3908a-2564-458a-9c0a-4565ebc9e202" released by "_delete_snapshot" :: held 3.374s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:36 devstack sudo[111314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-4a276d86-d41a-41ac-9812-87c0157b90ac" released by "delete_snapshot" :: held 3.405s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:36 devstack sudo[111314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:36 devstack sudo[111313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d Jun 23 20:29:36 devstack sudo[111313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Created reservations ['0d937097-b042-47b0-b973-6389f5e49462', '1a4029e3-deff-44e7-b26a-a05e6fef02d0', '44cb6914-68c6-4f5c-8bdd-3f831836bcf4', 'c75a3cef-5ace-4662-b6ae-577f506d4fd7'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Delete snapshot completed successfully. Jun 23 20:29:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-90962e1e-1841-4a4b-82e9-85eab1e8c3f4 tempest-TestStampPattern-1511669606 None] Lock "cinder-d7f3908a-2564-458a-9c0a-4565ebc9e202-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:37 devstack sudo[111314]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34" returned: 0 in 0.741s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:37 devstack sudo[111323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34 Jun 23 20:29:37 devstack sudo[111323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:37 devstack sudo[111313]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d" returned: 0 in 0.905s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:37 devstack sudo[111325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d Jun 23 20:29:37 devstack sudo[111325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:38 devstack sudo[111323]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908.41b12d0a-0bc2-428a-ae71-afd164764c34" returned: 0 in 0.666s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-41b12d0a-0bc2-428a-ae71-afd164764c34" released by "_delete_snapshot" :: held 3.345s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-c1db3964-2667-4753-8103-9c2be00a1908" released by "delete_snapshot" :: held 3.377s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Created reservations ['9d344935-b275-4eaa-93a9-70c2b49ea7d2', 'e1fec850-84d5-4e08-8b77-32e40006f7b4', '1f564d2d-0eba-4184-8354-28c727559bbd', '44a38e52-b4c0-43bc-b65e-bf363fccf4d4'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:38 devstack sudo[111325]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a686530-caad-4781-94cf-402c8896fe8d" returned: 0 in 0.723s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Lock "cinder-quobyte-2a686530-caad-4781-94cf-402c8896fe8d" released by "delete_volume" :: held 1.689s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Created reservations ['b1523953-4237-4c7c-819e-8e059cccae48', 'cba21cf3-24a0-4d22-9cc2-87aa207eb8ae', '8fd606e4-ac2d-45b3-91d0-f4c9d5c17e51', '2380b96b-5d19-4b43-b798-051dc0c8a751'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:38 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Delete snapshot completed successfully. Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2d8a677e-77d0-4a84-9f33-6c165745b770 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-41b12d0a-0bc2-428a-ae71-afd164764c34-delete_snapshot" released by "delete_snapshot" :: held 3.667s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:38 devstack sudo[111331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:38 devstack sudo[111331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-c1db3964-2667-4753-8103-9c2be00a1908-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-c1db3964-2667-4753-8103-9c2be00a1908-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-quobyte-c1db3964-2667-4753-8103-9c2be00a1908" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-c1db3964-2667-4753-8103-9c2be00a1908" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:39 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06c9e44-b074-4ec5-8974-e1c35374e317]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:39 devstack sudo[111334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 Jun 23 20:29:39 devstack sudo[111334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:39 devstack sudo[111331]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.913s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:39 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:39 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Deleted volume successfully. Jun 23 20:29:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-621039e9-f5d5-4221-80df-894ef95b7397 tempest-VolumesTransfersTest-22465053 None] Lock "cinder-2a686530-caad-4781-94cf-402c8896fe8d-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:40 devstack sudo[111334]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908" returned: 0 in 1.165s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:40 devstack sudo[111383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908 Jun 23 20:29:40 devstack sudo[111383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:41 devstack sudo[111383]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c1db3964-2667-4753-8103-9c2be00a1908" returned: 0 in 0.783s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-c1db3964-2667-4753-8103-9c2be00a1908" released by "delete_volume" :: held 2.034s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Created reservations ['3b869cf1-eeb5-46c5-bab3-d84c2763d9f0', 'aa66ea93-369d-453b-9678-596661bc3aba', '4e71aff3-3ea6-4e48-b0bf-939274c645d8', '1e13cc56-a439-446d-b737-fbacda4d4926'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:41 devstack sudo[111388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:41 devstack sudo[111388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:42 devstack sudo[111388]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.872s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Deleted volume successfully. Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-276b9653-29c6-4cd4-ba2b-bec65d0c2301 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-c1db3964-2667-4753-8103-9c2be00a1908-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "cinder-quobyte-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e2e1c-851e-4a93-98b7-0688010144e6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:42 devstack sudo[111392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 Jun 23 20:29:42 devstack sudo[111392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:43 devstack sudo[111392]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" returned: 0 in 0.861s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:43 devstack sudo[111397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40 Jun 23 20:29:43 devstack sudo[111397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:44 devstack sudo[111397]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" returned: 0 in 0.703s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-quobyte-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40" released by "delete_volume" :: held 1.639s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Created reservations ['9bff69c9-81fe-41ea-9c34-2d98fa8fc713', '3d86bab3-6cca-4556-9bd4-c773efd9da8d', 'cb441ad4-ffa2-4de5-b7ce-94dd24688d84', '5170922a-b475-464b-99a4-1202fa4d9264'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:44 devstack sudo[111400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:44 devstack sudo[111400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:44 devstack sudo[111400]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.739s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:45 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:45 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Deleted volume successfully. Jun 23 20:29:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ae1547c2-229c-408e-8178-0d45fb1074d8 tempest-SnapshotDependencyTests-607537574 None] Lock "cinder-e430fe19-1f4b-4a8d-9d02-aa3b45f97c40-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-4a276d86-d41a-41ac-9812-87c0157b90ac-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Lock "cinder-4a276d86-d41a-41ac-9812-87c0157b90ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Acquiring lock "cinder-quobyte-4a276d86-d41a-41ac-9812-87c0157b90ac" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-4a276d86-d41a-41ac-9812-87c0157b90ac" acquired by "delete_volume" :: waited 0.037s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8535e4f6-cc76-41c7-8a08-f991d39bc29b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:46 devstack sudo[111405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac Jun 23 20:29:46 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:46 devstack sudo[111407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:46 devstack sudo[111407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Flow 'volume_create_manager' (440f170e-aacb-4e20-8fa8-9fdd1e63ddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2521df0-8459-46c2-a1d9-d8dac80d1f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:47 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac" returned: 0 in 0.990s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2521df0-8459-46c2-a1d9-d8dac80d1f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1329901491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6679d75-b630-4726-bdfd-05fe1618ecb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50d871664d74df5b6b16421679803ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:47Z,use_quota=True,user_id='031de8396f63484fb1c81f404eb57aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ff3d21-cfad-4824-bf3d-d7bc324a50e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:47 devstack sudo[111413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac Jun 23 20:29:47 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ff3d21-cfad-4824-bf3d-d7bc324a50e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e57390d-ab05-41b9-90cc-eed5f64ebc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e57390d-ab05-41b9-90cc-eed5f64ebc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6679d75-b630-4726-bdfd-05fe1618ecb7', 'volume_name': 'volume-e6679d75-b630-4726-bdfd-05fe1618ecb7', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628d7b9e-80cc-4287-a8c1-492750feb871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628d7b9e-80cc-4287-a8c1-492750feb871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41179c8-6d0b-4c15-9869-334e0903b150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:47 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Volume e6679d75-b630-4726-bdfd-05fe1618ecb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6679d75-b630-4726-bdfd-05fe1618ecb7', 'volume_size': 1} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1329901491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6679d75-b630-4726-bdfd-05fe1618ecb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50d871664d74df5b6b16421679803ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:47Z,use_quota=True,user_id='031de8396f63484fb1c81f404eb57aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Creating volume e6679d75-b630-4726-bdfd-05fe1618ecb7 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:47 devstack sudo[111407]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:29:47 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.860s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:29:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:29:47 devstack sudo[111415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 1073741824 Jun 23 20:29:47 devstack sudo[111415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:48 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4a276d86-d41a-41ac-9812-87c0157b90ac" returned: 0 in 0.858s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Lock "cinder-quobyte-4a276d86-d41a-41ac-9812-87c0157b90ac" released by "delete_volume" :: held 1.958s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Created reservations ['e7b894b7-93d1-4daf-bbb3-a356f0eed6de', 'fafea323-5640-409a-97e3-49e5b33d8719', 'd8f299c5-f1da-4ee0-be51-bea3414f7d32', '8232dc0a-c232-492c-ab0a-7ec84f9d822a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=81,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=9 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=92,cinder:INSERT=27,cinder:UPDATE=108,cinder:DELETE=6 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:48 devstack sudo[111422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:48 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:48 devstack sudo[111415]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 1073741824" returned: 0 in 1.183s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:48 devstack sudo[111424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 Jun 23 20:29:48 devstack sudo[111424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:49 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.014s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Deleted volume successfully. Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa00b193-c218-4320-9d06-c0e1c11aa40c tempest-TestStampPattern-1511669606 None] Lock "cinder-4a276d86-d41a-41ac-9812-87c0157b90ac-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:49 devstack sudo[111424]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7" returned: 0 in 0.894s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41179c8-6d0b-4c15-9869-334e0903b150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6679d75-b630-4726-bdfd-05fe1618ecb7', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a297f0db-be49-4cc9-ad62-8091ebdc28a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:49 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Volume volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 (e6679d75-b630-4726-bdfd-05fe1618ecb7): created successfully Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a297f0db-be49-4cc9-ad62-8091ebdc28a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Flow 'volume_create_manager' (440f170e-aacb-4e20-8fa8-9fdd1e63ddd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-6e37d29b-2952-413e-9c66-491ba9f5bd9d tempest-VolumesTransfersV355Test-1128370066 None] Created volume successfully. Jun 23 20:29:51 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d98cca42-21e6-46eb-9228-5c200f465a8e tempest-VolumesTransfersV355Test-533438067 None] Transfer volume completed successfully. Jun 23 20:29:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Acquiring lock "cinder-e6679d75-b630-4726-bdfd-05fe1618ecb7-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Lock "cinder-e6679d75-b630-4726-bdfd-05fe1618ecb7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Acquiring lock "cinder-quobyte-e6679d75-b630-4726-bdfd-05fe1618ecb7" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Lock "cinder-quobyte-e6679d75-b630-4726-bdfd-05fe1618ecb7" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:52 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86406a6-d0d9-485c-a696-a7be7271e237]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:52 devstack sudo[111437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 Jun 23 20:29:52 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:53 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7" returned: 0 in 0.998s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:53 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7 Jun 23 20:29:53 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:54 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e6679d75-b630-4726-bdfd-05fe1618ecb7" returned: 0 in 0.901s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Lock "cinder-quobyte-e6679d75-b630-4726-bdfd-05fe1618ecb7" released by "delete_volume" :: held 1.962s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Created reservations ['78207bba-d1a5-48a9-b669-7f8d66cfca89', '85126cfe-ce21-49d8-8075-1efe3dc5740d', 'f6a6da48-6093-4186-9bef-33dd74bd6dd3', '63cdf522-4d2b-4b52-89df-4ba28171274d'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:54 devstack sudo[111447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:29:54 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Flow 'volume_create_manager' (8bb37ae1-089e-4494-91e7-e51c7200cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5137fd6b-74a7-48e5-8095-c2b65140e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:55 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5137fd6b-74a7-48e5-8095-c2b65140e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1913009321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c940403-8f9f-482d-a8b9-2e93826efca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50d871664d74df5b6b16421679803ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:56Z,use_quota=True,user_id='031de8396f63484fb1c81f404eb57aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520517eb-a62d-4a51-a185-7298f311e855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520517eb-a62d-4a51-a185-7298f311e855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6e5dee-9d3e-4415-b8bb-e2616eadf81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6e5dee-9d3e-4415-b8bb-e2616eadf81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c940403-8f9f-482d-a8b9-2e93826efca1', 'volume_name': 'volume-5c940403-8f9f-482d-a8b9-2e93826efca1', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e973eddb-cf56-4a71-9865-5680014870cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e973eddb-cf56-4a71-9865-5680014870cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f34340-554c-46b7-91e9-045a49f6ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:55 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Volume 5c940403-8f9f-482d-a8b9-2e93826efca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c940403-8f9f-482d-a8b9-2e93826efca1', 'volume_size': 1} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1913009321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c940403-8f9f-482d-a8b9-2e93826efca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50d871664d74df5b6b16421679803ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:29:56Z,use_quota=True,user_id='031de8396f63484fb1c81f404eb57aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Creating volume 5c940403-8f9f-482d-a8b9-2e93826efca1 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:29:55 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.226s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:29:55 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Deleted volume successfully. Jun 23 20:29:55 devstack sudo[111451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 1073741824 Jun 23 20:29:55 devstack sudo[111451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bb14311a-eaca-41c7-9033-7c257fdef3e0 tempest-VolumesTransfersV355Test-842560237 None] Lock "cinder-e6679d75-b630-4726-bdfd-05fe1618ecb7-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:29:56 devstack sudo[111451]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 1073741824" returned: 0 in 1.118s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:57 devstack sudo[111458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 Jun 23 20:29:57 devstack sudo[111458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:29:57 devstack sudo[111458]: pam_unix(sudo:session): session closed for user root Jun 23 20:29:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1" returned: 0 in 0.741s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:29:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:29:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:29:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f34340-554c-46b7-91e9-045a49f6ba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c940403-8f9f-482d-a8b9-2e93826efca1', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dc6dde-753c-4974-81fe-876350efb9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:29:57 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Volume volume-5c940403-8f9f-482d-a8b9-2e93826efca1 (5c940403-8f9f-482d-a8b9-2e93826efca1): created successfully Jun 23 20:29:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dc6dde-753c-4974-81fe-876350efb9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:29:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Flow 'volume_create_manager' (8bb37ae1-089e-4494-91e7-e51c7200cba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:29:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f81a06e3-df60-4ad1-bca3-8835dad14ca2 tempest-VolumesTransfersV355Test-1128370066 None] Created volume successfully. Jun 23 20:29:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Acquiring lock "cinder-5c940403-8f9f-482d-a8b9-2e93826efca1-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Lock "cinder-5c940403-8f9f-482d-a8b9-2e93826efca1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Acquiring lock "cinder-quobyte-5c940403-8f9f-482d-a8b9-2e93826efca1" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:29:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Lock "cinder-quobyte-5c940403-8f9f-482d-a8b9-2e93826efca1" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:29:59 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c865a9be-eed0-44de-80ea-143c0d414457]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:29:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:29:59 devstack sudo[111463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 Jun 23 20:29:59 devstack sudo[111463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:00 devstack sudo[111463]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1" returned: 0 in 0.829s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:00 devstack sudo[111469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1 Jun 23 20:30:00 devstack sudo[111469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:00 devstack sudo[111469]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5c940403-8f9f-482d-a8b9-2e93826efca1" returned: 0 in 0.676s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Lock "cinder-quobyte-5c940403-8f9f-482d-a8b9-2e93826efca1" released by "delete_volume" :: held 1.570s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Created reservations ['5660941d-d19c-4236-a57a-ea377dda5d4c', '200db084-7e90-400d-9d92-57d927d92ec2', '09983176-b7a8-4716-b826-0ee3a0a4f0b2', '51b72bab-5d41-4564-ae9f-1b9a41a0c0e4'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:00 devstack sudo[111472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:00 devstack sudo[111472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:01 devstack sudo[111472]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.682s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:01 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Deleted volume successfully. Jun 23 20:30:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8cadd140-6f67-47a2-971f-f25b4911ef34 tempest-VolumesTransfersV355Test-842560237 None] Lock "cinder-5c940403-8f9f-482d-a8b9-2e93826efca1-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (e34d3202-271f-4f03-9174-0db030a0ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba1db83-261c-4396-be8d-f3b9df12054f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba1db83-261c-4396-be8d-f3b9df12054f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-712163884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed91505-ddca-4f2d-9428-516798cf931d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:03Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d66d54e-8b06-4e22-a281-da551ac6b701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d66d54e-8b06-4e22-a281-da551ac6b701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a02583b-3683-4e85-81aa-e21024bdc18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a02583b-3683-4e85-81aa-e21024bdc18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed91505-ddca-4f2d-9428-516798cf931d', 'volume_name': 'volume-1ed91505-ddca-4f2d-9428-516798cf931d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213940df-f6cd-4598-aa38-0b885fbdefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213940df-f6cd-4598-aa38-0b885fbdefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2fc37d-94b2-4ce3-9299-11691ae9f793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Volume 1ed91505-ddca-4f2d-9428-516798cf931d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed91505-ddca-4f2d-9428-516798cf931d', 'volume_size': 1} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-712163884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed91505-ddca-4f2d-9428-516798cf931d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:03Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Creating volume 1ed91505-ddca-4f2d-9428-516798cf931d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:03 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:03 devstack sudo[111475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d 1073741824 Jun 23 20:30:03 devstack sudo[111475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (ed2b2705-d749-4802-a5d4-71ffbb0ced11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50db150-2f8b-491b-8fbb-4f5a4c6025d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50db150-2f8b-491b-8fbb-4f5a4c6025d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-710229043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3696dcaa-c0f1-4c0d-900e-61b463c4c9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:04Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abac9c74-8a75-4798-b556-b85bdc836ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abac9c74-8a75-4798-b556-b85bdc836ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a740a074-6b4d-415c-8951-9c6d7ac5df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a740a074-6b4d-415c-8951-9c6d7ac5df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3696dcaa-c0f1-4c0d-900e-61b463c4c9be', 'volume_name': 'volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90236610-fab8-4a2c-9d35-78793657df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90236610-fab8-4a2c-9d35-78793657df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9d6c58-3a58-4114-be4a-5f04044b2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:03 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Volume 3696dcaa-c0f1-4c0d-900e-61b463c4c9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be', 'volume_size': 1} Jun 23 20:30:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (97e94e76-e884-44db-a4cf-7cbc38c83625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd92c5b-2cef-45b7-9cfd-e4a2de4a0807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd92c5b-2cef-45b7-9cfd-e4a2de4a0807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343613628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:04Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51db2488-d16e-4d03-807a-1c7b3f78c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51db2488-d16e-4d03-807a-1c7b3f78c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300a190a-0fda-4279-837e-963c78ff0d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300a190a-0fda-4279-837e-963c78ff0d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3', 'volume_name': 'volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:04 devstack sudo[111475]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccdf0f2-646b-4a19-9212-755c45d4d509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccdf0f2-646b-4a19-9212-755c45d4d509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a13328-c304-444f-ad93-be4cb3e3df96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Volume 36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3', 'volume_size': 1} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d 1073741824" returned: 0 in 1.087s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:04 devstack sudo[111483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d Jun 23 20:30:04 devstack sudo[111483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (fb1d4341-23c4-49c3-8c11-6824a3102a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3374ce3-1b2d-4d46-a01e-982e9cf460cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3374ce3-1b2d-4d46-a01e-982e9cf460cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1248890870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e351cd8-4a9f-42e4-9134-80d98da928af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:05Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5271ca01-8fed-43ac-a9f6-7d282153e127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5271ca01-8fed-43ac-a9f6-7d282153e127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2077f164-d205-4fd4-8c1a-2f51177c7418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2077f164-d205-4fd4-8c1a-2f51177c7418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e351cd8-4a9f-42e4-9134-80d98da928af', 'volume_name': 'volume-3e351cd8-4a9f-42e4-9134-80d98da928af', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0a2342-5c88-4715-933c-ad9c8cec0f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0a2342-5c88-4715-933c-ad9c8cec0f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d7adf9-9d4a-44c6-8a55-42609d052df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:04 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Volume 3e351cd8-4a9f-42e4-9134-80d98da928af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e351cd8-4a9f-42e4-9134-80d98da928af', 'volume_size': 1} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (4dfff349-e4ff-4adf-b05e-cdbeb5a7b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:04 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae03a1a-509f-4880-b26f-3b7f00cab5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae03a1a-509f-4880-b26f-3b7f00cab5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209211611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261ab253-eb04-4fdf-b744-e8d26af45be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:05Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8d8ae5-f406-489b-b30d-b926fba2a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8d8ae5-f406-489b-b30d-b926fba2a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e400a587-5ad4-4dae-87df-ed3547be8bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e400a587-5ad4-4dae-87df-ed3547be8bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261ab253-eb04-4fdf-b744-e8d26af45be3', 'volume_name': 'volume-261ab253-eb04-4fdf-b744-e8d26af45be3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b86e078-0b17-426a-956b-66c11f25ee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b86e078-0b17-426a-956b-66c11f25ee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08f86cf-5145-4f3b-852d-02e603a9aec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:05 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Volume 261ab253-eb04-4fdf-b744-e8d26af45be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261ab253-eb04-4fdf-b744-e8d26af45be3', 'volume_size': 1} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:05 devstack sudo[111483]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d" returned: 0 in 0.811s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.440s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-710229043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3696dcaa-c0f1-4c0d-900e-61b463c4c9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:04Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Creating volume 3696dcaa-c0f1-4c0d-900e-61b463c4c9be {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:05 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:05 devstack sudo[111486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be 1073741824 Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2fc37d-94b2-4ce3-9299-11691ae9f793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed91505-ddca-4f2d-9428-516798cf931d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:05 devstack sudo[111486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d77f20-50f7-4b2e-b0ba-d2bf46600e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:05 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Volume volume-1ed91505-ddca-4f2d-9428-516798cf931d (1ed91505-ddca-4f2d-9428-516798cf931d): created successfully Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d77f20-50f7-4b2e-b0ba-d2bf46600e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (e34d3202-271f-4f03-9174-0db030a0ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:05 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a9a113e3-3477-436f-8f90-e408a36233e2 tempest-CreateVolumesFromImageTest-1011320806 None] Created volume successfully. Jun 23 20:30:06 devstack sudo[111486]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be 1073741824" returned: 0 in 0.918s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:06 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be Jun 23 20:30:06 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:06 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be" returned: 0 in 0.647s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.473s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343613628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:04Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Creating volume 36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:06 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:06 devstack sudo[111494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 1073741824 Jun 23 20:30:06 devstack sudo[111494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9d6c58-3a58-4114-be4a-5f04044b2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba132cd-b52b-4bb8-af5e-f56d315b4d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:06 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Volume volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be (3696dcaa-c0f1-4c0d-900e-61b463c4c9be): created successfully Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba132cd-b52b-4bb8-af5e-f56d315b4d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (ed2b2705-d749-4802-a5d4-71ffbb0ced11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:06 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c73e52d4-15be-4e8a-9540-d30e6b8a5c5c tempest-CreateVolumesFromImageTest-1011320806 None] Created volume successfully. Jun 23 20:30:07 devstack sudo[111494]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 1073741824" returned: 0 in 1.019s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:07 devstack sudo[111501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 Jun 23 20:30:07 devstack sudo[111501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:08 devstack sudo[111501]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3" returned: 0 in 0.679s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.783s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1248890870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e351cd8-4a9f-42e4-9134-80d98da928af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:05Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Creating volume 3e351cd8-4a9f-42e4-9134-80d98da928af {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:08 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:08 devstack sudo[111504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af 1073741824 Jun 23 20:30:08 devstack sudo[111504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a13328-c304-444f-ad93-be4cb3e3df96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b737fe59-131d-4137-a52e-65f1a9f028b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:08 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Volume volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 (36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3): created successfully Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b737fe59-131d-4137-a52e-65f1a9f028b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (97e94e76-e884-44db-a4cf-7cbc38c83625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c27b5619-1e0b-4b12-9253-d30e098b5d61 tempest-CreateVolumesFromImageTest-1011320806 None] Created volume successfully. Jun 23 20:30:09 devstack sudo[111504]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af 1073741824" returned: 0 in 0.996s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:09 devstack sudo[111509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af Jun 23 20:30:09 devstack sudo[111509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:10 devstack sudo[111509]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af" returned: 0 in 0.672s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.235s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209211611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261ab253-eb04-4fdf-b744-e8d26af45be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24825a780cca4c319fb0fea10dd84d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:05Z,use_quota=True,user_id='346b94109b8c4373a157a2b1679df0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Creating volume 261ab253-eb04-4fdf-b744-e8d26af45be3 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:10 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d7adf9-9d4a-44c6-8a55-42609d052df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e351cd8-4a9f-42e4-9134-80d98da928af', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:10 devstack sudo[111512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 1073741824 Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f157396d-0d17-4709-85d2-fcecb388a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:10 devstack sudo[111512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:10 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Volume volume-3e351cd8-4a9f-42e4-9134-80d98da928af (3e351cd8-4a9f-42e4-9134-80d98da928af): created successfully Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f157396d-0d17-4709-85d2-fcecb388a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (fb1d4341-23c4-49c3-8c11-6824a3102a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a660cb83-9e32-4091-91d7-30f4b8731785 tempest-CreateVolumesFromImageTest-1011320806 None] Created volume successfully. Jun 23 20:30:11 devstack sudo[111512]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 1073741824" returned: 0 in 0.947s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:11 devstack sudo[111518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 Jun 23 20:30:11 devstack sudo[111518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:12 devstack sudo[111518]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3" returned: 0 in 0.788s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08f86cf-5145-4f3b-852d-02e603a9aec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261ab253-eb04-4fdf-b744-e8d26af45be3', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1def33-2da6-4af1-a472-6341e0f74d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:12 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Volume volume-261ab253-eb04-4fdf-b744-e8d26af45be3 (261ab253-eb04-4fdf-b744-e8d26af45be3): created successfully Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1def33-2da6-4af1-a472-6341e0f74d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Flow 'volume_create_manager' (4dfff349-e4ff-4adf-b05e-cdbeb5a7b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:12 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-de0b48f6-5092-44ed-b74d-5cdb336678f8 tempest-CreateVolumesFromImageTest-1011320806 None] Created volume successfully. Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-261ab253-eb04-4fdf-b744-e8d26af45be3-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-261ab253-eb04-4fdf-b744-e8d26af45be3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-quobyte-261ab253-eb04-4fdf-b744-e8d26af45be3" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-261ab253-eb04-4fdf-b744-e8d26af45be3" acquired by "delete_volume" :: waited 0.035s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0f0ab0-f47c-4196-a1cb-b628cf64ed12]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:13 devstack sudo[111521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 Jun 23 20:30:13 devstack sudo[111521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:13 devstack sudo[111521]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3" returned: 0 in 0.962s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:13 devstack sudo[111526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3 Jun 23 20:30:13 devstack sudo[111526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:14 devstack sudo[111526]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-261ab253-eb04-4fdf-b744-e8d26af45be3" returned: 0 in 0.706s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-261ab253-eb04-4fdf-b744-e8d26af45be3" released by "delete_volume" :: held 1.718s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Created reservations ['f181062e-99f0-4807-8eb9-98a16966c83f', 'c88dbd97-f07d-4e98-9b57-39d95ba8415d', '7dafd8ec-80e3-4300-9648-45047fb10239', '4d35bd6e-9e75-40bc-aefb-51bca8748cc9'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:14 devstack sudo[111530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:14 devstack sudo[111530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-3e351cd8-4a9f-42e4-9134-80d98da928af-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-3e351cd8-4a9f-42e4-9134-80d98da928af-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-quobyte-3e351cd8-4a9f-42e4-9134-80d98da928af" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-3e351cd8-4a9f-42e4-9134-80d98da928af" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9a6c91-1bf1-49f6-bdf6-0c83a3e6b463]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:15 devstack sudo[111532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af Jun 23 20:30:15 devstack sudo[111532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:15 devstack sudo[111530]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.896s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Deleted volume successfully. Jun 23 20:30:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c0cb2cf7-f19d-49f6-950c-9f0b9f5bed58 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-261ab253-eb04-4fdf-b744-e8d26af45be3-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:16 devstack sudo[111532]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af" returned: 0 in 1.102s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:16 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af Jun 23 20:30:16 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Flow 'volume_create_manager' (a09f7705-f22c-45c0-8f29-1d70ef816b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d57c562-bc9f-453d-b410-c6bd656fb712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d57c562-bc9f-453d-b410-c6bd656fb712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900578588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f2b407-2277-4527-be17-538417dff26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330eef845a9f4102a8251bcada1d1b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:17Z,use_quota=True,user_id='4ea1d1afb2e64e6ca6ab47515e288378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758f98ce-483e-48dd-bc3b-decdf0a29fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758f98ce-483e-48dd-bc3b-decdf0a29fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a4ca51-07ad-4c1e-9876-141a12476b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a4ca51-07ad-4c1e-9876-141a12476b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f2b407-2277-4527-be17-538417dff26d', 'volume_name': 'volume-37f2b407-2277-4527-be17-538417dff26d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b747493b-a807-4e53-9a69-42803fd01ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b747493b-a807-4e53-9a69-42803fd01ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133d8f56-abea-495a-956c-9429929fae59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:16 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Volume 37f2b407-2277-4527-be17-538417dff26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f2b407-2277-4527-be17-538417dff26d', 'volume_size': 1} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900578588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f2b407-2277-4527-be17-538417dff26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330eef845a9f4102a8251bcada1d1b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:17Z,use_quota=True,user_id='4ea1d1afb2e64e6ca6ab47515e288378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Creating volume 37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:17 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:17 devstack sudo[111541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d 1073741824 Jun 23 20:30:17 devstack sudo[111541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:17 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3e351cd8-4a9f-42e4-9134-80d98da928af" returned: 0 in 0.722s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-3e351cd8-4a9f-42e4-9134-80d98da928af" released by "delete_volume" :: held 1.890s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Created reservations ['6cae1830-1a76-488b-b940-68e4b71e17e4', '6c7acf19-909c-415c-9cd1-c58b4fe0dca8', 'b30aa0b9-5f8c-405d-9864-d49c494fe8d4', '3d29521a-ff63-47a5-8b6d-a0c11e749a50'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:17 devstack sudo[111543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:17 devstack sudo[111543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-quobyte-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3" acquired by "delete_volume" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bade6dca-51f2-4765-baea-29a9cdd989aa]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:17 devstack sudo[111545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 Jun 23 20:30:17 devstack sudo[111545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:17 devstack sudo[111541]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d 1073741824" returned: 0 in 0.923s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:17 devstack sudo[111551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:30:17 devstack sudo[111551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:17 devstack sudo[111543]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.752s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:17 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Deleted volume successfully. Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7ac3474a-1d31-4b59-8f71-cbe801aa8284 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-3e351cd8-4a9f-42e4-9134-80d98da928af-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:18 devstack sudo[111545]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3" returned: 0 in 0.876s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:18 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3 Jun 23 20:30:18 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:18 devstack sudo[111551]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.730s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133d8f56-abea-495a-956c-9429929fae59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f2b407-2277-4527-be17-538417dff26d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92956189-8186-4992-b4be-b53a806dae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:18 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Volume volume-37f2b407-2277-4527-be17-538417dff26d (37f2b407-2277-4527-be17-538417dff26d): created successfully Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92956189-8186-4992-b4be-b53a806dae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Flow 'volume_create_manager' (a09f7705-f22c-45c0-8f29-1d70ef816b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d861bd6b-efca-473e-bb51-dad332096aba tempest-VolumesActionsTest-454648577 None] Created volume successfully. Jun 23 20:30:19 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3" returned: 0 in 0.726s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3" released by "delete_volume" :: held 1.659s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Created reservations ['2ab89933-b3c7-4e8e-aa7c-59f74da246b2', 'cc0e2362-4cdc-4759-838b-74799b6e1f8b', '22d2f55e-4290-42ec-bca8-74cef8ca0b8a', '33878809-1986-4899-8356-ece695dec355'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:19 devstack sudo[111560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:19 devstack sudo[111560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-3696dcaa-c0f1-4c0d-900e-61b463c4c9be-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-3696dcaa-c0f1-4c0d-900e-61b463c4c9be-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-quobyte-3696dcaa-c0f1-4c0d-900e-61b463c4c9be" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-3696dcaa-c0f1-4c0d-900e-61b463c4c9be" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d1cf10-6dac-4f54-94db-cd05ccbaf40a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:19 devstack sudo[111563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be Jun 23 20:30:19 devstack sudo[111563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:20 devstack sudo[111560]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.790s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:20 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:20 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Deleted volume successfully. Jun 23 20:30:20 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-35b2a25f-7244-425c-991d-cc671b13d170 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-36c1ec7f-b0c9-4782-acf6-38d3fa12f6d3-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:20 devstack sudo[111563]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be" returned: 0 in 0.914s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:20 devstack sudo[111572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be Jun 23 20:30:20 devstack sudo[111572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:21 devstack sudo[111572]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3696dcaa-c0f1-4c0d-900e-61b463c4c9be" returned: 0 in 0.757s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-3696dcaa-c0f1-4c0d-900e-61b463c4c9be" released by "delete_volume" :: held 1.719s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Created reservations ['76643762-f5e8-49f5-9041-d169fc4d64f0', '4f1fd283-0ac3-419f-9ef3-6ed3a6b75f56', 'ea3020df-19bc-4fce-9bfd-1d898b7f6a45', '64a40b6f-b948-4bd5-a84d-ad9047e35c42'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:21 devstack sudo[111575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:21 devstack sudo[111575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-1ed91505-ddca-4f2d-9428-516798cf931d-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:21 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-1ed91505-ddca-4f2d-9428-516798cf931d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "cinder-quobyte-1ed91505-ddca-4f2d-9428-516798cf931d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-1ed91505-ddca-4f2d-9428-516798cf931d" acquired by "delete_volume" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3fc799-8155-4dc8-84a6-2b07fdbe0315]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:22 devstack sudo[111577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d Jun 23 20:30:22 devstack sudo[111577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:22 devstack sudo[111575]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.711s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:22 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Deleted volume successfully. Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-da8983e7-060d-4d00-b1f8-d52f8a757ba0 tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-3696dcaa-c0f1-4c0d-900e-61b463c4c9be-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:22 devstack sudo[111577]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d" returned: 0 in 0.784s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:22 devstack sudo[111585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d Jun 23 20:30:22 devstack sudo[111585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:23 devstack sudo[111585]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1ed91505-ddca-4f2d-9428-516798cf931d" returned: 0 in 0.693s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-quobyte-1ed91505-ddca-4f2d-9428-516798cf931d" released by "delete_volume" :: held 1.522s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Created reservations ['785acc4d-9b1d-4c42-9260-0df1fcd48117', '459b9131-c9c5-4090-929b-dec860f274fa', '97405a37-431c-4115-9855-e848cd468c77', 'e76e2203-4e2a-4d37-808b-3dae16247e7c'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:23 devstack sudo[111588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:23 devstack sudo[111588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:24 devstack sudo[111588]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.665s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:24 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:24 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Deleted volume successfully. Jun 23 20:30:24 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-929fa09f-7384-41a7-8576-1d0bb909412e tempest-CreateVolumesFromImageTest-1011320806 None] Lock "cinder-1ed91505-ddca-4f2d-9428-516798cf931d-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (1e4dbdf2-a7f4-4ffa-bb89-fd4588cb7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd06f68-beb7-42c8-823c-118db2912092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd06f68-beb7-42c8-823c-118db2912092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466220952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5688c4-e24b-4d79-8417-46eaca133d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:28Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c6ca38-f794-4c4b-aa8c-40d2824a826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c6ca38-f794-4c4b-aa8c-40d2824a826f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c282c6d-0ae0-4495-ae10-129e9b18a58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c282c6d-0ae0-4495-ae10-129e9b18a58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5688c4-e24b-4d79-8417-46eaca133d71', 'volume_name': 'volume-3b5688c4-e24b-4d79-8417-46eaca133d71', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf922d18-0713-474e-81a2-26ff1eb01c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf922d18-0713-474e-81a2-26ff1eb01c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44d09e9-a14d-47b4-b1d3-4f275732be4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:27 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume 3b5688c4-e24b-4d79-8417-46eaca133d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5688c4-e24b-4d79-8417-46eaca133d71', 'volume_size': 1} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466220952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5688c4-e24b-4d79-8417-46eaca133d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:28Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Creating volume 3b5688c4-e24b-4d79-8417-46eaca133d71 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:27 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:27 devstack sudo[111611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 1073741824 Jun 23 20:30:27 devstack sudo[111611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:28 devstack sudo[111611]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 1073741824" returned: 0 in 0.899s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:28 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 Jun 23 20:30:28 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:29 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71" returned: 0 in 0.818s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:29 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44d09e9-a14d-47b4-b1d3-4f275732be4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5688c4-e24b-4d79-8417-46eaca133d71', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14bfb17c-61d3-4357-b5c7-65579c547621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:29 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume volume-3b5688c4-e24b-4d79-8417-46eaca133d71 (3b5688c4-e24b-4d79-8417-46eaca133d71): created successfully Jun 23 20:30:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14bfb17c-61d3-4357-b5c7-65579c547621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:29 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (1e4dbdf2-a7f4-4ffa-bb89-fd4588cb7870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:29 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ed9a2e00-6840-437a-b7c3-6f34f7c62d32 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created volume successfully. Jun 23 20:30:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Creating offline snapshot 06781b05-7aea-41c1-91d5-0a51448d7dc2 of volume 3b5688c4-e24b-4d79-8417-46eaca133d71 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:30:30 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92f3186-72b6-44a9-b5dc-dbe7eb1c2536]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:30 devstack sudo[111656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 Jun 23 20:30:30 devstack sudo[111656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:30 devstack sudo[111656]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71" returned: 0 in 0.822s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:30 devstack sudo[111664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 1G Jun 23 20:30:30 devstack sudo[111664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:31 devstack sudo[111664]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 1G" returned: 0 in 0.856s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b5688c4-e24b-4d79-8417-46eaca133d71 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:31 devstack sudo[111670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b5688c4-e24b-4d79-8417-46eaca133d71 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 Jun 23 20:30:31 devstack sudo[111670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:32 devstack sudo[111670]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b5688c4-e24b-4d79-8417-46eaca133d71 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2" returned: 0 in 0.727s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:32 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 is being set with open permissions: ugo+rw Jun 23 20:30:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:32 devstack sudo[111690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 Jun 23 20:30:32 devstack sudo[111690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:33 devstack sudo[111690]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2" returned: 0 in 1.061s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:33 devstack sudo[111758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.info Jun 23 20:30:33 devstack sudo[111758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:34 devstack sudo[111758]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.info" returned: 0 in 0.681s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:34 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.info is being set with open permissions: ugo+rw Jun 23 20:30:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:34 devstack sudo[111763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.info Jun 23 20:30:34 devstack sudo[111763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:34 devstack sudo[111763]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.info" returned: 0 in 0.701s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.955s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:35 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-64357165-4253-4b7e-83c4-644d46681d4b tempest-CreateVolumesFromSnapshotTest-1498356774 None] Create snapshot completed successfully Jun 23 20:30:35 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (2941cce3-afb9-499a-b2dc-d387eeda1a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb9d966-9fc1-4795-b34d-22deec4a20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb9d966-9fc1-4795-b34d-22deec4a20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-123835333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:36Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb66bfa-68f7-4584-9444-1cb835b5cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb66bfa-68f7-4584-9444-1cb835b5cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34779ae4-11d5-49be-8e14-8eb72c81b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34779ae4-11d5-49be-8e14-8eb72c81b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d', 'volume_name': 'volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa5379c-312b-4207-8ed9-c4d1b860d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa5379c-312b-4207-8ed9-c4d1b860d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5906fc5d-1983-4903-923b-e147ea535dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume 7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d', 'volume_size': 1} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-123835333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:36Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Creating volume 7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:36 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:36 devstack sudo[111767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d 1073741824 Jun 23 20:30:36 devstack sudo[111767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (01e68a99-a31a-4482-bb72-2e3989f1734b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ddcf80-19ee-4a35-b9fd-21636311afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ddcf80-19ee-4a35-b9fd-21636311afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-112799741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a0310f-a530-4861-a9ec-89bc263f5a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:36Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bab3a4-3350-4159-9026-17f6640efb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bab3a4-3350-4159-9026-17f6640efb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6868d070-b4b9-4fc0-ab36-0bb9f2b02d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6868d070-b4b9-4fc0-ab36-0bb9f2b02d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a0310f-a530-4861-a9ec-89bc263f5a6f', 'volume_name': 'volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1d68b9-b739-44fc-ac95-cfa83b2cebef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1d68b9-b739-44fc-ac95-cfa83b2cebef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18eb5795-5588-42c8-8580-99a9895e74db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume b1a0310f-a530-4861-a9ec-89bc263f5a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f', 'volume_size': 1} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f045d501-848d-4362-b18d-d8ef94e39153 tempest-VolumesActionsTest-454648577 None] Acquiring lock "cinder-37f2b407-2277-4527-be17-538417dff26d" by "attach_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f045d501-848d-4362-b18d-d8ef94e39153 tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d" acquired by "attach_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f045d501-848d-4362-b18d-d8ef94e39153 tempest-VolumesActionsTest-454648577 None] Attaching volume 37f2b407-2277-4527-be17-538417dff26d to instance edb0220e-63fd-4155-9f78-09f4dfb0f0f1 at mountpoint /dev/vdb on host None. Jun 23 20:30:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f045d501-848d-4362-b18d-d8ef94e39153 tempest-VolumesActionsTest-454648577 None] Attach volume completed successfully. Jun 23 20:30:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f045d501-848d-4362-b18d-d8ef94e39153 tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d" released by "attach_volume" :: held 0.139s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (cc546a4d-5e97-4157-a2c9-845a4e3b9918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63c7dcf-a7ae-4a81-9eb1-d3961bf1d4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63c7dcf-a7ae-4a81-9eb1-d3961bf1d4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184017293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e9655b-784c-468d-b95b-ee548e762b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:37Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875bf95c-8ef5-450f-93e8-00a9954bd3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875bf95c-8ef5-450f-93e8-00a9954bd3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d7a3bb-ec8e-481c-9421-588a7beac57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d7a3bb-ec8e-481c-9421-588a7beac57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e9655b-784c-468d-b95b-ee548e762b9f', 'volume_name': 'volume-17e9655b-784c-468d-b95b-ee548e762b9f', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8eb3280-dde8-4269-b0ec-789f2d8c9cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8eb3280-dde8-4269-b0ec-789f2d8c9cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb9d860-6d63-40c3-9f11-c072f851b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume 17e9655b-784c-468d-b95b-ee548e762b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e9655b-784c-468d-b95b-ee548e762b9f', 'volume_size': 1} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3897a390-bf42-4c2e-bfb0-61b470422ede tempest-VolumesActionsTest-454648577 None] Acquiring lock "cinder-37f2b407-2277-4527-be17-538417dff26d-detach_volume" by "detach_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3897a390-bf42-4c2e-bfb0-61b470422ede tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3897a390-bf42-4c2e-bfb0-61b470422ede tempest-VolumesActionsTest-454648577 None] Detaching volume 37f2b407-2277-4527-be17-538417dff26d from instance edb0220e-63fd-4155-9f78-09f4dfb0f0f1. Jun 23 20:30:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3897a390-bf42-4c2e-bfb0-61b470422ede tempest-VolumesActionsTest-454648577 None] Detach volume completed successfully. Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3897a390-bf42-4c2e-bfb0-61b470422ede tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:37 devstack sudo[111767]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d 1073741824" returned: 0 in 1.520s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (3cfc5750-3db1-46e7-932a-1ed5a069572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5acfd24-f700-4c97-92ea-651e75f908a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5acfd24-f700-4c97-92ea-651e75f908a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034432559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e17e589-8dcb-4231-80b5-94608a953094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:38Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04374c64-c700-4130-bf2c-2bc3ee4f5648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04374c64-c700-4130-bf2c-2bc3ee4f5648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8fed8d-cfb3-4e76-a5fb-f4b6aac86d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8fed8d-cfb3-4e76-a5fb-f4b6aac86d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e17e589-8dcb-4231-80b5-94608a953094', 'volume_name': 'volume-0e17e589-8dcb-4231-80b5-94608a953094', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90e972-e801-40e6-a314-3e773a2f600c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90e972-e801-40e6-a314-3e773a2f600c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd5f142-9faa-446d-a0cb-6462a80c45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume 0e17e589-8dcb-4231-80b5-94608a953094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e17e589-8dcb-4231-80b5-94608a953094', 'volume_size': 1} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:37 devstack sudo[111772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d Jun 23 20:30:37 devstack sudo[111772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (3ad0965b-a356-4900-90c2-bf4145a5a11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78dc19f-2c16-4374-9f37-3684b124e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78dc19f-2c16-4374-9f37-3684b124e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712722788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:38Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1937ad3a-38bc-4c16-825c-4abf273aa1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1937ad3a-38bc-4c16-825c-4abf273aa1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae021cb8-5988-48c8-a08b-b4b802276482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae021cb8-5988-48c8-a08b-b4b802276482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4', 'volume_name': 'volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44708327-01b1-4a8f-96ad-ad47bcb1c354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44708327-01b1-4a8f-96ad-ad47bcb1c354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6529562a-6344-405c-9779-babb9ed39dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:38 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume 0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4', 'volume_size': 1} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:38 devstack sudo[111772]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d" returned: 0 in 0.856s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.533s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-112799741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a0310f-a530-4861-a9ec-89bc263f5a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:36Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Creating volume b1a0310f-a530-4861-a9ec-89bc263f5a6f {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:38 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5906fc5d-1983-4903-923b-e147ea535dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:38 devstack sudo[111775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f 1073741824 Jun 23 20:30:38 devstack sudo[111775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a1c65e-c87a-4187-94fb-3b01c81f4df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:38 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d (7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d): created successfully Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a1c65e-c87a-4187-94fb-3b01c81f4df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (2941cce3-afb9-499a-b2dc-d387eeda1a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:38 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a2b825cf-2227-4c33-9a8b-f257cadc7b18 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created volume successfully. Jun 23 20:30:39 devstack sudo[111775]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f 1073741824" returned: 0 in 1.131s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:39 devstack sudo[111820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f Jun 23 20:30:39 devstack sudo[111820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:40 devstack sudo[111820]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f" returned: 0 in 0.700s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.258s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184017293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e9655b-784c-468d-b95b-ee548e762b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:37Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Creating volume 17e9655b-784c-468d-b95b-ee548e762b9f {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:40 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18eb5795-5588-42c8-8580-99a9895e74db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c279d9-804a-460a-a066-ae0ade5b936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:40 devstack sudo[111824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f 1073741824 Jun 23 20:30:40 devstack sudo[111824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:40 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f (b1a0310f-a530-4861-a9ec-89bc263f5a6f): created successfully Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c279d9-804a-460a-a066-ae0ade5b936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:40 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (01e68a99-a31a-4482-bb72-2e3989f1734b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ca3ae25e-29d7-404c-a7f2-4f09968ca174 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created volume successfully. Jun 23 20:30:41 devstack sudo[111824]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f 1073741824" returned: 0 in 0.963s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:41 devstack sudo[111832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f Jun 23 20:30:41 devstack sudo[111832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:42 devstack sudo[111832]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f" returned: 0 in 0.662s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.433s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034432559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e17e589-8dcb-4231-80b5-94608a953094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:38Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Creating volume 0e17e589-8dcb-4231-80b5-94608a953094 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:42 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:42 devstack sudo[111835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 1073741824 Jun 23 20:30:42 devstack sudo[111835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb9d860-6d63-40c3-9f11-c072f851b39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e9655b-784c-468d-b95b-ee548e762b9f', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd700cb-9319-422e-a8ac-18a19845090f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:42 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume volume-17e9655b-784c-468d-b95b-ee548e762b9f (17e9655b-784c-468d-b95b-ee548e762b9f): created successfully Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd700cb-9319-422e-a8ac-18a19845090f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (cc546a4d-5e97-4157-a2c9-845a4e3b9918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-30ac3758-ca41-4ea3-acd1-6389fce11fd9 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created volume successfully. Jun 23 20:30:42 devstack sudo[111835]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 1073741824" returned: 0 in 0.821s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:43 devstack sudo[111842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 Jun 23 20:30:43 devstack sudo[111842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:43 devstack sudo[111842]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094" returned: 0 in 0.702s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.515s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712722788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3cbda326c4f1a8aca1780ba90b44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:30:38Z,use_quota=True,user_id='d578fcf6016f4813a3d8b7cf9f379f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Creating volume 0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:30:43 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd5f142-9faa-446d-a0cb-6462a80c45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e17e589-8dcb-4231-80b5-94608a953094', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:43 devstack sudo[111845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 1073741824 Jun 23 20:30:43 devstack sudo[111845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e7a2cc-90a4-4533-931d-7a4d007c8c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:43 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume volume-0e17e589-8dcb-4231-80b5-94608a953094 (0e17e589-8dcb-4231-80b5-94608a953094): created successfully Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e7a2cc-90a4-4533-931d-7a4d007c8c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:43 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (3cfc5750-3db1-46e7-932a-1ed5a069572e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:43 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-af05781c-6dbd-4486-a421-b53dbb5f6832 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created volume successfully. Jun 23 20:30:44 devstack sudo[111845]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 1073741824" returned: 0 in 0.849s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:44 devstack sudo[111852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 Jun 23 20:30:44 devstack sudo[111852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:45 devstack sudo[111852]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4" returned: 0 in 0.643s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:30:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6529562a-6344-405c-9779-babb9ed39dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a60afa9-8143-45eb-a2cc-123982b7e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:30:45 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Volume volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 (0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4): created successfully Jun 23 20:30:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a60afa9-8143-45eb-a2cc-123982b7e042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:30:45 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Flow 'volume_create_manager' (3ad0965b-a356-4900-90c2-bf4145a5a11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:30:45 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e31ef1d6-ecbd-4fda-8f1e-80d84889a2f4 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created volume successfully. Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-quobyte-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11dc319-f323-442c-b30e-651302098d4f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:46 devstack sudo[111855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 Jun 23 20:30:46 devstack sudo[111855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:46 devstack sudo[111860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:46 devstack sudo[111860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:46 devstack sudo[111855]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4" returned: 0 in 0.851s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:47 devstack sudo[111865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4 Jun 23 20:30:47 devstack sudo[111865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:47 devstack sudo[111860]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.714s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:30:47 devstack sudo[111865]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4" returned: 0 in 0.728s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4" released by "delete_volume" :: held 1.631s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created reservations ['e638eef9-6c35-4980-a745-15b85f7421f0', 'e89c3fd2-442f-4c08-af51-b6bc15026663', 'f5eaf94a-81c1-4bc9-9560-7c8f1be18ef3', '2422a985-7595-40f1-b4e7-5f8e53cab3d7'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:47 devstack sudo[111869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:47 devstack sudo[111869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-0e17e589-8dcb-4231-80b5-94608a953094-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-0e17e589-8dcb-4231-80b5-94608a953094-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-quobyte-0e17e589-8dcb-4231-80b5-94608a953094" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-0e17e589-8dcb-4231-80b5-94608a953094" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2543b224-1aee-4231-bf59-a5fcdf63f197]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:48 devstack sudo[111871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 Jun 23 20:30:48 devstack sudo[111871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:48 devstack sudo[111869]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.775s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:48 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Deleted volume successfully. Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=110,cinder:INSERT=26,cinder:DELETE=14,cinder:SELECT=80 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:30:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aff82490-81fe-42c6-8117-69ac27f132fc tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-0a7f9d53-373f-4b8d-b6cc-f50b2d5266a4-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:49 devstack sudo[111871]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094" returned: 0 in 0.785s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:49 devstack sudo[111877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094 Jun 23 20:30:49 devstack sudo[111877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:49 devstack sudo[111877]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-0e17e589-8dcb-4231-80b5-94608a953094" returned: 0 in 0.697s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-0e17e589-8dcb-4231-80b5-94608a953094" released by "delete_volume" :: held 1.528s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:49 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=79,cinder:UPDATE=119,cinder:DELETE=10,cinder:INSERT=23 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:30:49 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created reservations ['565b675d-b5c2-41ad-89b2-56d1f12d1646', '6e134a44-82bc-4395-ba4a-7b2a7c8d6068', '0d023ebd-136f-4d1d-91a3-97e4ea45b947', '3e8db8b4-213b-41bb-adf0-007df85230ce'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:50 devstack sudo[111880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:50 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-17e9655b-784c-468d-b95b-ee548e762b9f-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-17e9655b-784c-468d-b95b-ee548e762b9f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-quobyte-17e9655b-784c-468d-b95b-ee548e762b9f" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-17e9655b-784c-468d-b95b-ee548e762b9f" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a96cf5-4f5e-43cc-b077-f02b685b7b7a]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:50 devstack sudo[111883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f Jun 23 20:30:50 devstack sudo[111883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:50 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.725s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:50 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Deleted volume successfully. Jun 23 20:30:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-33460f24-40e9-487c-9445-c1b465b9d608 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-0e17e589-8dcb-4231-80b5-94608a953094-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:51 devstack sudo[111883]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f" returned: 0 in 0.827s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:51 devstack sudo[111894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f Jun 23 20:30:51 devstack sudo[111894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:52 devstack sudo[111894]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-17e9655b-784c-468d-b95b-ee548e762b9f" returned: 0 in 0.729s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-17e9655b-784c-468d-b95b-ee548e762b9f" released by "delete_volume" :: held 1.603s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created reservations ['8dde8409-a108-4a0f-b9ca-1f58f2075ad8', '2906a7a1-94c2-4f2d-acb9-4566fff7d861', 'a2359e0d-c7e9-4f50-ae35-107a1507ccbb', 'c26a075f-2274-4815-a673-5c8d8e7581e7'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:52 devstack sudo[111897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:52 devstack sudo[111897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-b1a0310f-a530-4861-a9ec-89bc263f5a6f-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-b1a0310f-a530-4861-a9ec-89bc263f5a6f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-quobyte-b1a0310f-a530-4861-a9ec-89bc263f5a6f" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-b1a0310f-a530-4861-a9ec-89bc263f5a6f" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebd855f-fa8f-4043-ab9e-3a8dc0118085]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:53 devstack sudo[111899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f Jun 23 20:30:53 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:53 devstack sudo[111897]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.820s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:53 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:53 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Deleted volume successfully. Jun 23 20:30:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-1ffd6221-30e8-4b43-9a11-70342b3c2caf tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-17e9655b-784c-468d-b95b-ee548e762b9f-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:53 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f" returned: 0 in 0.910s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:53 devstack sudo[111921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f Jun 23 20:30:53 devstack sudo[111921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:54 devstack sudo[111921]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b1a0310f-a530-4861-a9ec-89bc263f5a6f" returned: 0 in 0.664s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-b1a0310f-a530-4861-a9ec-89bc263f5a6f" released by "delete_volume" :: held 1.616s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created reservations ['eb55a0d5-e328-4dae-8e8c-95ffbd87b9fe', '6cdaea9d-9427-4e37-8622-235692bcc1b1', '7cf0771f-cc13-401c-9aa9-fc53862400fa', '0228378f-a932-4acd-82ed-741d7aaf78ee'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:54 devstack sudo[111925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:54 devstack sudo[111925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-quobyte-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21194b8-2fef-470d-a5fd-a7760fca3657]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:55 devstack sudo[111925]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.707s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:55 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Deleted volume successfully. Jun 23 20:30:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-80f5fc32-d23e-43c6-a452-0f501a2ac552 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-b1a0310f-a530-4861-a9ec-89bc263f5a6f-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:55 devstack sudo[111928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d Jun 23 20:30:55 devstack sudo[111928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:56 devstack sudo[111928]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d" returned: 0 in 0.807s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:56 devstack sudo[111933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d Jun 23 20:30:56 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:56 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d" returned: 0 in 0.706s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d" released by "delete_volume" :: held 1.565s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created reservations ['55e789ee-8313-4757-9d85-b55eb9afd74e', 'b90fe967-b276-4571-bf96-1a053fff605b', '68e14144-d7bf-46c5-b6cb-fc9ec3cf157a', 'c9605ba8-8cda-48ef-9f54-9494d696ec04'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:30:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:56 devstack sudo[111940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:30:56 devstack sudo[111940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-06781b05-7aea-41c1-91d5-0a51448d7dc2-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-06781b05-7aea-41c1-91d5-0a51448d7dc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-quobyte-3b5688c4-e24b-4d79-8417-46eaca133d71" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-3b5688c4-e24b-4d79-8417-46eaca133d71" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-quobyte-06781b05-7aea-41c1-91d5-0a51448d7dc2" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-06781b05-7aea-41c1-91d5-0a51448d7dc2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Deleting offline snapshot 06781b05-7aea-41c1-91d5-0a51448d7dc2 of volume 3b5688c4-e24b-4d79-8417-46eaca133d71 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] snapshot_file for this snap is: volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd3be91-46ad-4ee3-98cd-218b55d004a6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:57 devstack sudo[111942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 Jun 23 20:30:57 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:57 devstack sudo[111940]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.740s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:30:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Deleted volume successfully. Jun 23 20:30:57 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9f6abec7-137a-4e03-9361-9ad1fc231828 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-7aa1385f-d8e9-4c1f-bfee-8c3d0f05209d-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:30:58 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2" returned: 0 in 0.764s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:58 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b5688c4-e24b-4d79-8417-46eaca133d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:30:58 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dd3076-185d-4c98-b6b9-af29b7300a6f]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:30:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:58 devstack sudo[111952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 Jun 23 20:30:58 devstack sudo[111952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:30:59 devstack sudo[111952]: pam_unix(sudo:session): session closed for user root Jun 23 20:30:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71" returned: 0 in 1.197s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:30:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:30:59 devstack sudo[112026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 Jun 23 20:30:59 devstack sudo[112026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:00 devstack sudo[112026]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2" returned: 0 in 0.961s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:00 devstack sudo[112043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2 Jun 23 20:31:00 devstack sudo[112043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:01 devstack sudo[112043]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71.06781b05-7aea-41c1-91d5-0a51448d7dc2" returned: 0 in 0.700s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-06781b05-7aea-41c1-91d5-0a51448d7dc2" released by "_delete_snapshot" :: held 3.769s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-3b5688c4-e24b-4d79-8417-46eaca133d71" released by "delete_snapshot" :: held 3.802s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created reservations ['c32011b1-e3c5-4708-a33e-d3f80c64001b', '36b4bf4e-7b27-45ee-b9a0-f9a33db23cfb', '9597eaa7-c742-405f-9aa3-3b9692b7556d', 'f30c9e5c-8dba-4619-a56c-53650846c8c1'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:31:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Delete snapshot completed successfully. Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-715aa5a1-a3c8-4d5c-9ca6-ee38a28c7382 tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-06781b05-7aea-41c1-91d5-0a51448d7dc2-delete_snapshot" released by "delete_snapshot" :: held 3.989s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-3b5688c4-e24b-4d79-8417-46eaca133d71-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-3b5688c4-e24b-4d79-8417-46eaca133d71-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "cinder-quobyte-3b5688c4-e24b-4d79-8417-46eaca133d71" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-3b5688c4-e24b-4d79-8417-46eaca133d71" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5cd313-ed26-449c-986f-93dac6c7a588]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8fc4a026-11ba-48cb-a30e-41b1664cff62 tempest-VolumesActionsTest-454648577 None] Acquiring lock "cinder-37f2b407-2277-4527-be17-538417dff26d" by "attach_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8fc4a026-11ba-48cb-a30e-41b1664cff62 tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d" acquired by "attach_volume" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:31:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8fc4a026-11ba-48cb-a30e-41b1664cff62 tempest-VolumesActionsTest-454648577 None] Attaching volume 37f2b407-2277-4527-be17-538417dff26d to instance 409b3181-dc19-45bf-9bea-0a9cab6aa29c at mountpoint /dev/vdb on host None. Jun 23 20:31:01 devstack sudo[112046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 Jun 23 20:31:01 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:01 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8fc4a026-11ba-48cb-a30e-41b1664cff62 tempest-VolumesActionsTest-454648577 None] Attach volume completed successfully. Jun 23 20:31:01 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8fc4a026-11ba-48cb-a30e-41b1664cff62 tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d" released by "attach_volume" :: held 0.108s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:31:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e267a29d-99f1-4c33-8c2e-c9950e28235a tempest-VolumesActionsTest-454648577 None] Acquiring lock "cinder-37f2b407-2277-4527-be17-538417dff26d-detach_volume" by "detach_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:31:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e267a29d-99f1-4c33-8c2e-c9950e28235a tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:31:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e267a29d-99f1-4c33-8c2e-c9950e28235a tempest-VolumesActionsTest-454648577 None] Detaching volume 37f2b407-2277-4527-be17-538417dff26d from instance 409b3181-dc19-45bf-9bea-0a9cab6aa29c. Jun 23 20:31:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e267a29d-99f1-4c33-8c2e-c9950e28235a tempest-VolumesActionsTest-454648577 None] Detach volume completed successfully. Jun 23 20:31:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e267a29d-99f1-4c33-8c2e-c9950e28235a tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:31:02 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71" returned: 0 in 0.857s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:02 devstack sudo[112051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71 Jun 23 20:31:02 devstack sudo[112051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:03 devstack sudo[112051]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3b5688c4-e24b-4d79-8417-46eaca133d71" returned: 0 in 0.735s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-quobyte-3b5688c4-e24b-4d79-8417-46eaca133d71" released by "delete_volume" :: held 1.678s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Created reservations ['6733b777-443d-44bd-a9eb-5907894fb426', 'e3b542fe-23d7-441c-b9d4-39757ea953c2', '27006d0e-bf9c-49f9-88e9-dcd52c8ebfdf', 'a556c435-3573-41f8-abaf-52ce9741eba8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:31:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:03 devstack sudo[112054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:31:03 devstack sudo[112054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:04 devstack sudo[112054]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.669s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:04 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:31:04 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Deleted volume successfully. Jun 23 20:31:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-0c7fcb3a-667e-409b-983b-09b35911b5dd tempest-CreateVolumesFromSnapshotTest-1498356774 None] Lock "cinder-3b5688c4-e24b-4d79-8417-46eaca133d71-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:31:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:31:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:31:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b896a518-f2bd-416e-b494-485e5839de71]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:11 devstack sudo[112103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:31:11 devstack sudo[112103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:11 devstack sudo[112103]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.751s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c8af74-dc14-46bf-9d7f-188f0c207f22]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:12 devstack sudo[112108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:31:12 devstack sudo[112108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:12 devstack sudo[112108]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.743s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.ea8774f5-e39c-43e6-9e6d-7ea4b00b082c2kzfb3na.img {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:12 devstack sudo[112113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.ea8774f5-e39c-43e6-9e6d-7ea4b00b082c2kzfb3na.img Jun 23 20:31:12 devstack sudo[112113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:17 devstack sudo[112113]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.ea8774f5-e39c-43e6-9e6d-7ea4b00b082c2kzfb3na.img" returned: 0 in 4.426s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:17 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70cc98a-168a-4cff-b70e-b9e5da842910]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:17 devstack sudo[112127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:31:17 devstack sudo[112127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:18 devstack sudo[112127]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.966s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:18 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.ea8774f5-e39c-43e6-9e6d-7ea4b00b082c2kzfb3na.img {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:31:18 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Converted 1024.00 MB image at 231.30 MB/s Jun 23 20:31:18 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] ea8774f5-e39c-43e6-9e6d-7ea4b00b082c was raw, no need to convert to raw {{(pid=93739) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 23 20:31:28 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=34,cinder:INSERT=11,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:31:28 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:INSERT=15,cinder:UPDATE=49,cinder:SELECT=41,cinder:DELETE=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:31:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.754s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:31:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Uploaded volume to glance image-id: ea8774f5-e39c-43e6-9e6d-7ea4b00b082c. {{(pid=93739) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 20:31:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ff342071-e7f5-40a4-91d0-649d3037c408 tempest-VolumesActionsTest-454648577 None] Copy volume to image completed successfully. Jun 23 20:31:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:31:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:31:37 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[232d30a9-9128-4ef1-a0dc-d2eba73dfd98]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:38 devstack sudo[112176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:31:38 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:38 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.765s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:38 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[626cc372-6edb-479c-95b2-6ac2b74726d1]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:38 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:31:38 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:39 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.748s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:39 devstack sudo[112186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img Jun 23 20:31:39 devstack sudo[112186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:43 devstack sudo[112186]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img" returned: 0 in 4.471s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:43 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf01129-3db5-4afa-9527-a88b24e2cd4d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:44 devstack sudo[112199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:31:44 devstack sudo[112199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:44 devstack sudo[112199]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.974s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:44 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:31:44 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Converted 1024.00 MB image at 228.98 MB/s Jun 23 20:31:44 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] 29c21216-b4e1-4d69-8d4a-ccc058368689 was raw, converting to qcow2 {{(pid=93739) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 23 20:31:44 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f52ef-1e10-4d48-bcff-a27a668bf028]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:45 devstack sudo[112205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img Jun 23 20:31:45 devstack sudo[112205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:45 devstack sudo[112205]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img" returned: 0 in 0.775s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:45 devstack sudo[112209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img Jun 23 20:31:45 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:46 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img" returned: 1 in 0.726s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img /opt/stack/data/cinder/conversion/vol_upload_xo2rbbx5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:46 devstack sudo[112214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img /opt/stack/data/cinder/conversion/vol_upload_xo2rbbx5 Jun 23 20:31:46 devstack sudo[112214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:31:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:46 devstack sudo[112216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:31:46 devstack sudo[112216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:47 devstack sudo[112214]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img /opt/stack/data/cinder/conversion/vol_upload_xo2rbbx5" returned: 0 in 0.746s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Image conversion details: src /opt/stack/data/cinder/conversion/37f2b407-2277-4527-be17-538417dff26d.temp_image.29c21216-b4e1-4d69-8d4a-ccc058368689i83stn4l.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_xo2rbbx5 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:31:47 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb8b027-5c3b-4469-9135-bc983eb956e3]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xo2rbbx5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:47 devstack sudo[112221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xo2rbbx5 Jun 23 20:31:47 devstack sudo[112221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:47 devstack sudo[112216]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.728s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:31:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:31:48 devstack sudo[112221]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xo2rbbx5" returned: 0 in 0.788s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.477s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:31:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Uploaded volume to glance image-id: 29c21216-b4e1-4d69-8d4a-ccc058368689. {{(pid=93739) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 20:31:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5480022e-06ff-4cb1-b6a3-1146485ec741 tempest-VolumesActionsTest-454648577 None] Copy volume to image completed successfully. Jun 23 20:31:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Acquiring lock "cinder-37f2b407-2277-4527-be17-538417dff26d-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:31:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:31:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Acquiring lock "cinder-quobyte-37f2b407-2277-4527-be17-538417dff26d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:31:50 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Lock "cinder-quobyte-37f2b407-2277-4527-be17-538417dff26d" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:31:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a13f64-d572-4dd1-8855-399209391c9b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:31:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:50 devstack sudo[112227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:31:50 devstack sudo[112227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:50 devstack sudo[112227]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.772s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:51 devstack sudo[112238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d Jun 23 20:31:51 devstack sudo[112238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:51 devstack sudo[112238]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37f2b407-2277-4527-be17-538417dff26d" returned: 0 in 0.648s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Lock "cinder-quobyte-37f2b407-2277-4527-be17-538417dff26d" released by "delete_volume" :: held 1.459s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Created reservations ['b23cc5a8-4d33-4b30-8e51-f122a2b2d170', '40e4c1d4-0ae1-4e1f-b08f-645715389501', '27e056d2-bb05-4b51-80e9-6152fba5387b', 'bf6d4cb0-12ca-44de-a86c-8ac6128707a7'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:31:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:31:51 devstack sudo[112241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:31:51 devstack sudo[112241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:31:52 devstack sudo[112241]: pam_unix(sudo:session): session closed for user root Jun 23 20:31:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.712s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:31:52 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:31:52 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Deleted volume successfully. Jun 23 20:31:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c49539ee-440a-4e27-a4b8-d53b5fd8e9ac tempest-VolumesActionsTest-454648577 None] Lock "cinder-37f2b407-2277-4527-be17-538417dff26d-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:32:01 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:32:02 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:32:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:32:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:32:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:32:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:32:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:32:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:32:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:32:46 devstack sudo[112403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:32:46 devstack sudo[112403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:32:47 devstack sudo[112403]: pam_unix(sudo:session): session closed for user root Jun 23 20:32:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.651s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:32:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:32:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:32:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:32:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:33:00 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:33:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Flow 'volume_create_manager' (becf079a-cdfc-468b-88b0-e7ba8e6895df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:33:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76018332-928f-42b4-b6c5-e764a2f93875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:00 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76018332-928f-42b4-b6c5-e764a2f93875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1182336735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25130a77-e508-4558-bf8a-51973dc4b2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a809261671b843218987a9a980cca7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:33:01Z,use_quota=True,user_id='6c2e0f852c2e4f6c97f51f542b8fe812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20211de9-3da9-439f-97d2-f5807a489bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20211de9-3da9-439f-97d2-f5807a489bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07498bd2-15ac-4668-95c5-46ff1cd29e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07498bd2-15ac-4668-95c5-46ff1cd29e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25130a77-e508-4558-bf8a-51973dc4b2b9', 'volume_name': 'volume-25130a77-e508-4558-bf8a-51973dc4b2b9', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b66020d-5810-4cfa-acea-a475fc5312ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b66020d-5810-4cfa-acea-a475fc5312ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf0f932-8cea-4cbe-8b2a-381b6dc7a0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:01 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Volume 25130a77-e508-4558-bf8a-51973dc4b2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25130a77-e508-4558-bf8a-51973dc4b2b9', 'volume_size': 1} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1182336735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25130a77-e508-4558-bf8a-51973dc4b2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a809261671b843218987a9a980cca7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:33:01Z,use_quota=True,user_id='6c2e0f852c2e4f6c97f51f542b8fe812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Creating volume 25130a77-e508-4558-bf8a-51973dc4b2b9 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:33:01 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:01 devstack sudo[112436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 1073741824 Jun 23 20:33:01 devstack sudo[112436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:01 devstack sudo[112436]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 1073741824" returned: 0 in 0.830s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:01 devstack sudo[112441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 Jun 23 20:33:01 devstack sudo[112441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:02 devstack sudo[112441]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9" returned: 0 in 0.629s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:33:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:33:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf0f932-8cea-4cbe-8b2a-381b6dc7a0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25130a77-e508-4558-bf8a-51973dc4b2b9', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5787ae90-54ae-4077-9413-f026837e558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:02 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Volume volume-25130a77-e508-4558-bf8a-51973dc4b2b9 (25130a77-e508-4558-bf8a-51973dc4b2b9): created successfully Jun 23 20:33:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5787ae90-54ae-4077-9413-f026837e558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:02 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Flow 'volume_create_manager' (becf079a-cdfc-468b-88b0-e7ba8e6895df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:33:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a54159f3-e6f4-4844-aeb1-68070fecd5a8 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Created volume successfully. Jun 23 20:33:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-71e6f98d-dbe7-4ee2-84a4-195422ead077 req-8254a3e2-9705-423e-9e56-c6ef7a5fd89a tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:33:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-71e6f98d-dbe7-4ee2-84a4-195422ead077 req-8254a3e2-9705-423e-9e56-c6ef7a5fd89a tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:33:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fccb9ed-a433-4db9-9b0e-897ea9c8bc63]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:33:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-71e6f98d-dbe7-4ee2-84a4-195422ead077 req-8254a3e2-9705-423e-9e56-c6ef7a5fd89a tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:06 devstack sudo[112456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 Jun 23 20:33:06 devstack sudo[112456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:06 devstack sudo[112456]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [req-71e6f98d-dbe7-4ee2-84a4-195422ead077 req-8254a3e2-9705-423e-9e56-c6ef7a5fd89a tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9" returned: 0 in 0.755s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [req-71e6f98d-dbe7-4ee2-84a4-195422ead077 req-8254a3e2-9705-423e-9e56-c6ef7a5fd89a tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:33:06 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-71e6f98d-dbe7-4ee2-84a4-195422ead077 req-8254a3e2-9705-423e-9e56-c6ef7a5fd89a tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9', 'name': 'volume-25130a77-e508-4558-bf8a-51973dc4b2b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16c5eea8-11e5-41c6-8c21-d188566a66c9', 'enforce_multipath': True} {{(pid=93739) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 20:33:06 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-71e6f98d-dbe7-4ee2-84a4-195422ead077 req-8254a3e2-9705-423e-9e56-c6ef7a5fd89a tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] attachment_update completed successfully. Jun 23 20:33:13 devstack cinder-volume[93739]: INFO cinder.volume.manager [req-943b0255-e0c8-47a5-8acb-0e070dd0bb4d req-03303dac-c061-4123-8ff4-afb26bb51b23 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Terminate volume connection completed successfully. Jun 23 20:33:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [req-943b0255-e0c8-47a5-8acb-0e070dd0bb4d req-03303dac-c061-4123-8ff4-afb26bb51b23 tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Deleting attachment 16c5eea8-11e5-41c6-8c21-d188566a66c9. {{(pid=93739) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 20:33:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Acquiring lock "cinder-25130a77-e508-4558-bf8a-51973dc4b2b9-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:33:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "cinder-25130a77-e508-4558-bf8a-51973dc4b2b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:33:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Acquiring lock "cinder-quobyte-25130a77-e508-4558-bf8a-51973dc4b2b9" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:33:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "cinder-quobyte-25130a77-e508-4558-bf8a-51973dc4b2b9" acquired by "delete_volume" :: waited 0.014s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:33:15 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a742a247-ae3b-4b7d-b37c-ee2d18bada06]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:33:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:15 devstack sudo[112878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 Jun 23 20:33:15 devstack sudo[112878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:15 devstack sudo[112878]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9" returned: 0 in 0.738s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:15 devstack sudo[112883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9 Jun 23 20:33:15 devstack sudo[112883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:16 devstack sudo[112883]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-25130a77-e508-4558-bf8a-51973dc4b2b9" returned: 0 in 0.624s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "cinder-quobyte-25130a77-e508-4558-bf8a-51973dc4b2b9" released by "delete_volume" :: held 1.397s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Created reservations ['555f68b2-91ed-4101-8fb9-cf8319fc16f5', 'dc0328dd-3756-4036-80c2-aba1398e0dc0', '8b2b816c-203f-4e39-b5dd-54cca7708b76', '763492e3-0fec-42e2-883c-2dbbe84687de'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:33:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:16 devstack sudo[112886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:33:16 devstack sudo[112886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:17 devstack sudo[112886]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.634s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:17 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:33:17 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Deleted volume successfully. Jun 23 20:33:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-5457e7ce-4d67-4d40-b5fd-a57259ac21ac tempest-TestServerVolumeAttachScenarioOldVersion-87501555 None] Lock "cinder-25130a77-e508-4558-bf8a-51973dc4b2b9-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:33:26 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:INSERT=2 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:33:27 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=11,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=2 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Flow 'volume_create_manager' (7f331887-bbd0-4512-8697-28691ea8df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2c34cf-87b5-4355-9dce-482b719367f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2c34cf-87b5-4355-9dce-482b719367f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cebbd1-74eb-443e-b903-0563aa8356ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f4819bc16b4555a31ef20253b41a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:33:38Z,use_quota=True,user_id='4d213abfd840467ab878e390539dbf3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1af53d6-3f18-4eeb-9034-10c715d370e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1af53d6-3f18-4eeb-9034-10c715d370e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbad403e-d752-480b-b349-5d94535f843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbad403e-d752-480b-b349-5d94535f843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58cebbd1-74eb-443e-b903-0563aa8356ac', 'volume_name': 'volume-58cebbd1-74eb-443e-b903-0563aa8356ac', 'volume_size': 1, 'image_id': '35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c52934a67aaea8b7e47ec9a43ae2349', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19f4819bc16b4555a31ef20253b41a5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '811fb38a28b34bc0da8dd919c8e2b42eb5007a97b349eb2c259fc82d0d5cea9db0f811bfb4b983de285c7385fd3d992a5c742d77c12e3db75389afb02c9c582d', 'id': '35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'created_at': datetime.datetime(2026, 6, 23, 18, 33, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611/file', 'properties': {}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8132f0b-9938-4182-a94a-ac6d525b9789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8132f0b-9938-4182-a94a-ac6d525b9789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803eb4e6-d185-4467-bec6-cbaa084bfcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:38 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Volume 58cebbd1-74eb-443e-b903-0563aa8356ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58cebbd1-74eb-443e-b903-0563aa8356ac', 'volume_size': 1, 'image_id': '35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c52934a67aaea8b7e47ec9a43ae2349', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19f4819bc16b4555a31ef20253b41a5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '811fb38a28b34bc0da8dd919c8e2b42eb5007a97b349eb2c259fc82d0d5cea9db0f811bfb4b983de285c7385fd3d992a5c742d77c12e3db75389afb02c9c582d', 'id': '35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'created_at': datetime.datetime(2026, 6, 23, 18, 33, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611/file', 'properties': {}}, 'image_service': } Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Trying to clone 58cebbd1-74eb-443e-b903-0563aa8356ac from image 35f0a6d4-abe1-4fc9-9f1c-000f6ca22611 at location (None, [{'url': 'file:///opt/stack/data/glance/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:33:38 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Image download 0.00 MB at 0.00 MB/s Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75cb8eb-344c-4ea0-930d-d74ea9b992fb]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:33:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:38 devstack sudo[113037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD Jun 23 20:33:38 devstack sudo[113037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:39 devstack sudo[113037]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD" returned: 0 in 0.719s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:39 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD Jun 23 20:33:39 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:40 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD" returned: 1 in 0.706s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:33:40 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Temporary image 35f0a6d4-abe1-4fc9-9f1c-000f6ca22611 is fetched for user 4d213abfd840467ab878e390539dbf3a. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:33:40 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b21ac9c-ae5b-4d4d-95d3-4673e1f350eb]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:33:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:40 devstack sudo[113046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD Jun 23 20:33:40 devstack sudo[113046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:40 devstack sudo[113046]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD" returned: 0 in 0.691s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:41 devstack sudo[113050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD Jun 23 20:33:41 devstack sudo[113050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:41 devstack sudo[113050]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD" returned: 1 in 0.705s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cebbd1-74eb-443e-b903-0563aa8356ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f4819bc16b4555a31ef20253b41a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:33:38Z,use_quota=True,user_id='4d213abfd840467ab878e390539dbf3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Creating volume 58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:33:41 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:33:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:41 devstack sudo[113055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac 1073741824 Jun 23 20:33:41 devstack sudo[113055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:42 devstack sudo[113055]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac 1073741824" returned: 0 in 0.795s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:42 devstack sudo[113060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac Jun 23 20:33:42 devstack sudo[113060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:43 devstack sudo[113060]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac" returned: 0 in 0.634s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:33:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:33:43 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Attempting download of 35f0a6d4-abe1-4fc9-9f1c-000f6ca22611 ((None, [{'url': 'file:///opt/stack/data/glance/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'metadata': {}}])) to volume 58cebbd1-74eb-443e-b903-0563aa8356ac. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:33:43 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cb80bd-3160-4351-b1cd-94cf4c11e1f7]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:33:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_o0t67zrd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:43 devstack sudo[113063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_o0t67zrd Jun 23 20:33:43 devstack sudo[113063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:43 devstack sudo[113063]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_o0t67zrd" returned: 0 in 0.725s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_o0t67zrd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:44 devstack sudo[113067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_o0t67zrd Jun 23 20:33:44 devstack sudo[113067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:44 devstack sudo[113067]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_o0t67zrd" returned: 1 in 0.728s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_o0t67zrd' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:33:44 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d373947-0497-4a9b-9b2f-b5416ccefc55]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:33:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:44 devstack sudo[113072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD Jun 23 20:33:44 devstack sudo[113072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:45 devstack sudo[113072]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD" returned: 0 in 0.702s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:45 devstack sudo[113076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD Jun 23 20:33:45 devstack sudo[113076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:46 devstack sudo[113076]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD" returned: 1 in 0.692s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] 35f0a6d4-abe1-4fc9-9f1c-000f6ca22611 was raw, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:46 devstack sudo[113081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac Jun 23 20:33:46 devstack sudo[113081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:46 devstack sudo[113086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:33:46 devstack sudo[113086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:46 devstack sudo[113081]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac" returned: 0 in 0.706s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35f0a6d4-abe1-4fc9-9f1c-000f6ca22611_0blvyt93devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:33:46 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 20:33:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:46 devstack sudo[113088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac 1G Jun 23 20:33:46 devstack sudo[113088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:47 devstack sudo[113086]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.636s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:33:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:33:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:33:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:33:47 devstack sudo[113088]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac 1G" returned: 0 in 0.656s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa087fd-f720-413f-ac88-4956d48bf96d]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:33:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:47 devstack sudo[113094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac Jun 23 20:33:47 devstack sudo[113094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:48 devstack sudo[113094]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac" returned: 0 in 0.730s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:48 devstack sudo[113098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac Jun 23 20:33:48 devstack sudo[113098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:48 devstack sudo[113098]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac" returned: 1 in 0.719s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Downloaded image 35f0a6d4-abe1-4fc9-9f1c-000f6ca22611 ((None, [{'url': 'file:///opt/stack/data/glance/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'metadata': {}}])) to volume 58cebbd1-74eb-443e-b903-0563aa8356ac successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Temporary image 35f0a6d4-abe1-4fc9-9f1c-000f6ca22611 for user 4d213abfd840467ab878e390539dbf3a is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Marking volume 58cebbd1-74eb-443e-b903-0563aa8356ac as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Copying metadata from image 35f0a6d4-abe1-4fc9-9f1c-000f6ca22611 to 58cebbd1-74eb-443e-b903-0563aa8356ac. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Creating volume glance metadata for volume 58cebbd1-74eb-443e-b903-0563aa8356ac backed by image 35f0a6d4-abe1-4fc9-9f1c-000f6ca22611 with: {'image_id': '35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0c52934a67aaea8b7e47ec9a43ae2349', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803eb4e6-d185-4467-bec6-cbaa084bfcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cebbd1-74eb-443e-b903-0563aa8356ac', 'volume_size': 1, 'image_id': '35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c52934a67aaea8b7e47ec9a43ae2349', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19f4819bc16b4555a31ef20253b41a5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '811fb38a28b34bc0da8dd919c8e2b42eb5007a97b349eb2c259fc82d0d5cea9db0f811bfb4b983de285c7385fd3d992a5c742d77c12e3db75389afb02c9c582d', 'id': '35f0a6d4-abe1-4fc9-9f1c-000f6ca22611', 'created_at': datetime.datetime(2026, 6, 23, 18, 33, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 33, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35f0a6d4-abe1-4fc9-9f1c-000f6ca22611/file', 'properties': {}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea36b3b-1ad9-4c42-b450-26e02e817f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:33:48 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Volume volume-58cebbd1-74eb-443e-b903-0563aa8356ac (58cebbd1-74eb-443e-b903-0563aa8356ac): created successfully Jun 23 20:33:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea36b3b-1ad9-4c42-b450-26e02e817f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:33:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Flow 'volume_create_manager' (7f331887-bbd0-4512-8697-28691ea8df91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:33:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4cc64569-288a-4dd9-aef3-1deb44b8911c tempest-VolumeImageDependencyTests-500175055 None] Created volume successfully. Jun 23 20:33:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Acquiring lock "cinder-58cebbd1-74eb-443e-b903-0563aa8356ac-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:33:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Lock "cinder-58cebbd1-74eb-443e-b903-0563aa8356ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:33:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Acquiring lock "cinder-quobyte-58cebbd1-74eb-443e-b903-0563aa8356ac" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:33:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Lock "cinder-quobyte-58cebbd1-74eb-443e-b903-0563aa8356ac" acquired by "delete_volume" :: waited 0.013s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:33:50 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9b67b-d841-47d6-bb3e-f5e1cf98ae6f]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:33:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:50 devstack sudo[113103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac Jun 23 20:33:50 devstack sudo[113103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:50 devstack sudo[113103]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac" returned: 0 in 0.724s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:50 devstack sudo[113107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac Jun 23 20:33:50 devstack sudo[113107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:51 devstack sudo[113107]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac" returned: 1 in 0.723s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:33:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:51 devstack sudo[113118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac Jun 23 20:33:51 devstack sudo[113118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:52 devstack sudo[113118]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-58cebbd1-74eb-443e-b903-0563aa8356ac" returned: 0 in 0.612s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Lock "cinder-quobyte-58cebbd1-74eb-443e-b903-0563aa8356ac" released by "delete_volume" :: held 2.120s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Created reservations ['0399e82b-6592-4ebd-821f-968d3008cfde', 'fcff9a6b-ad41-4815-8fa5-046ff1e0ed66', '37559894-3164-4d71-80ed-af9059f84edb', '550bf492-051a-4576-9e71-09ded5acfd9a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:33:52 devstack sudo[113121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:33:52 devstack sudo[113121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:33:52 devstack sudo[113121]: pam_unix(sudo:session): session closed for user root Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.654s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:33:52 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Deleted volume successfully. Jun 23 20:33:52 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-aa8cc2b3-66ed-4366-bab8-1acfb2b6f657 tempest-VolumeImageDependencyTests-500175055 None] Lock "cinder-58cebbd1-74eb-443e-b903-0563aa8356ac-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:02 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=12,cinder:SELECT=12,cinder:INSERT=7 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:34:02 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Flow 'volume_create_manager' (52d1f01d-4a16-437c-920e-3cb77354a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de107cd-c123-47c8-a3b3-ae065aae2261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de107cd-c123-47c8-a3b3-ae065aae2261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-663967420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468e74c4-3092-48a0-8322-efefac471c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6dd611733c488aa1022a2f8d06d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:06Z,use_quota=True,user_id='13862ce123364b9abc668764c4ad933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071c9e50-652a-4953-bf57-909be6b1b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071c9e50-652a-4953-bf57-909be6b1b08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d816910a-5cf6-4368-be3b-85a02b36ce5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d816910a-5cf6-4368-be3b-85a02b36ce5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468e74c4-3092-48a0-8322-efefac471c34', 'volume_name': 'volume-468e74c4-3092-48a0-8322-efefac471c34', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408d5ca5-9d22-4474-bc62-5a60edcc6ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408d5ca5-9d22-4474-bc62-5a60edcc6ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e15f8d-4f0c-4ebd-811f-ecb0d90d0360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Volume 468e74c4-3092-48a0-8322-efefac471c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468e74c4-3092-48a0-8322-efefac471c34', 'volume_size': 1} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-663967420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468e74c4-3092-48a0-8322-efefac471c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6dd611733c488aa1022a2f8d06d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:06Z,use_quota=True,user_id='13862ce123364b9abc668764c4ad933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Creating volume 468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:05 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:05 devstack sudo[113165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 1073741824 Jun 23 20:34:05 devstack sudo[113165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (a2d30f3c-3b5f-4541-b8ea-5ab9f0055dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb54a5a2-6c22-4f47-9ddd-f248335d4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb54a5a2-6c22-4f47-9ddd-f248335d4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-709958295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a707662-7c13-415d-bf3d-ace0a6516c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:06Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ca08fa-adb9-4966-a0cb-49293d95a6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ca08fa-adb9-4966-a0cb-49293d95a6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df0ee35-c2b4-4646-86be-7defefd06ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df0ee35-c2b4-4646-86be-7defefd06ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a707662-7c13-415d-bf3d-ace0a6516c95', 'volume_name': 'volume-2a707662-7c13-415d-bf3d-ace0a6516c95', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e49f84-64e2-4b09-90d7-45583d68e284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e49f84-64e2-4b09-90d7-45583d68e284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e156372-ca2c-47b0-8def-38d5214d9dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:05 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume 2a707662-7c13-415d-bf3d-ace0a6516c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a707662-7c13-415d-bf3d-ace0a6516c95', 'volume_size': 1} Jun 23 20:34:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:06 devstack sudo[113165]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 1073741824" returned: 0 in 0.971s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:06 devstack sudo[113173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 Jun 23 20:34:06 devstack sudo[113173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:07 devstack sudo[113173]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34" returned: 0 in 0.734s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-709958295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a707662-7c13-415d-bf3d-ace0a6516c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:06Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Creating volume 2a707662-7c13-415d-bf3d-ace0a6516c95 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:07 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:07 devstack sudo[113176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 1073741824 Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e15f8d-4f0c-4ebd-811f-ecb0d90d0360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468e74c4-3092-48a0-8322-efefac471c34', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:07 devstack sudo[113176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f91554-679a-42be-8220-670f7b71b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:07 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Volume volume-468e74c4-3092-48a0-8322-efefac471c34 (468e74c4-3092-48a0-8322-efefac471c34): created successfully Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f91554-679a-42be-8220-670f7b71b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:07 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Flow 'volume_create_manager' (52d1f01d-4a16-437c-920e-3cb77354a970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:07 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-0e56c802-69cf-482a-8c59-12990a090e5b tempest-VolumeDependencyTests-368025864 None] Created volume successfully. Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Flow 'volume_create_manager' (ba572fa6-ad6c-4239-a128-5d5bccc76cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a035ee-c491-47f1-aa36-fe6f7ad235e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a035ee-c491-47f1-aa36-fe6f7ad235e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e18c90-1f72-44c0-a427-92503c388ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f253f6a086d405185149f74a22c14a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:08Z,use_quota=True,user_id='6041aaa89db142e881d852f585638530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36e86d3-f454-4c82-88e5-e9ebcdd87f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36e86d3-f454-4c82-88e5-e9ebcdd87f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5d1c63-ca7b-4cda-9c40-bd3f52186bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:34:08 devstack sudo[113176]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 1073741824" returned: 0 in 1.167s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:08 devstack sudo[113181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 Jun 23 20:34:08 devstack sudo[113181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5d1c63-ca7b-4cda-9c40-bd3f52186bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '28e18c90-1f72-44c0-a427-92503c388ec7', 'volume_name': 'volume-28e18c90-1f72-44c0-a427-92503c388ec7', 'volume_size': 1, 'image_id': 'd461408e-129e-4b73-9857-660d80200fa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d461408e-129e-4b73-9857-660d80200fa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be776089c1579457c3daac69d7397ee1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f253f6a086d405185149f74a22c14a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cd0712be76f99eb68c33d832c5bcdca89a81dbc9fedfa06af8f42a9609ca83974ee65e9a0d8dd4b9cb7cb547381b828a24c1a3f9b2dbbe1121709bfb87eb90c', 'id': 'd461408e-129e-4b73-9857-660d80200fa2', 'created_at': datetime.datetime(2026, 6, 23, 18, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d461408e-129e-4b73-9857-660d80200fa2/file', 'properties': {}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fffd10-fcd5-4f8a-9c0c-d6cd1c819ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fffd10-fcd5-4f8a-9c0c-d6cd1c819ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe4c27c-ed62-46fa-b45c-0d592ae40a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:08 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Volume 28e18c90-1f72-44c0-a427-92503c388ec7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-28e18c90-1f72-44c0-a427-92503c388ec7', 'volume_size': 1, 'image_id': 'd461408e-129e-4b73-9857-660d80200fa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d461408e-129e-4b73-9857-660d80200fa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be776089c1579457c3daac69d7397ee1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f253f6a086d405185149f74a22c14a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cd0712be76f99eb68c33d832c5bcdca89a81dbc9fedfa06af8f42a9609ca83974ee65e9a0d8dd4b9cb7cb547381b828a24c1a3f9b2dbbe1121709bfb87eb90c', 'id': 'd461408e-129e-4b73-9857-660d80200fa2', 'created_at': datetime.datetime(2026, 6, 23, 18, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d461408e-129e-4b73-9857-660d80200fa2/file', 'properties': {}}, 'image_service': } Jun 23 20:34:08 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Trying to clone 28e18c90-1f72-44c0-a427-92503c388ec7 from image d461408e-129e-4b73-9857-660d80200fa2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d461408e-129e-4b73-9857-660d80200fa2', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:34:09 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Image download 0.00 MB at 0.00 MB/s Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[10131c08-dc4e-406a-9212-fe67e1c99b3b]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:09 devstack sudo[113183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD Jun 23 20:34:09 devstack sudo[113183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:09 devstack sudo[113181]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95" returned: 0 in 0.795s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.615s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Creating offline snapshot bf2d95a0-a13b-415c-b598-fc480e946bff of volume 468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e156372-ca2c-47b0-8def-38d5214d9dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a707662-7c13-415d-bf3d-ace0a6516c95', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b269f35-29cf-48c4-ad0a-620f5f3c3ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7175899-4653-4c41-8bf3-71ca55cc4cb1]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:09 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume volume-2a707662-7c13-415d-bf3d-ace0a6516c95 (2a707662-7c13-415d-bf3d-ace0a6516c95): created successfully Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b269f35-29cf-48c4-ad0a-620f5f3c3ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (a2d30f3c-3b5f-4541-b8ea-5ab9f0055dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Flow 'volume_create_manager' (c3c3cfa3-b4fc-4d6b-8f93-13687dad00fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bd2bea-ae1b-4ba1-a0f6-354565ceb31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:09 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-22124a53-8080-4d9f-87cc-370bcc36828b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created volume successfully. Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bd2bea-ae1b-4ba1-a0f6-354565ceb31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b53d018-8ee3-4e7e-b675-3173ea2272b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631bf43dcd5465bb7b3652efdb945ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:10Z,use_quota=True,user_id='82068a69d7c04a089961635734bd5889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7ec61b9-0b99-4e2a-9850-69f3d1789f30),volume_type_id=c7ec61b9-0b99-4e2a-9850-69f3d1789f30)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01197c8-d4c1-4aed-8f99-e86ca1c1eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01197c8-d4c1-4aed-8f99-e86ca1c1eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05f47be-fcad-4930-8a4b-708b28934980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:09 devstack cinder-volume[93739]: DEBUG cinder.image.glance [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Creating Keystone auth plugin from conf {{(pid=93739) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 20:34:09 devstack sudo[113186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 Jun 23 20:34:09 devstack sudo[113186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:10 devstack sudo[113183]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05f47be-fcad-4930-8a4b-708b28934980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b53d018-8ee3-4e7e-b675-3173ea2272b0', 'volume_name': 'volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0', 'volume_size': 1, 'image_id': '26e4eede-ff36-4fd4-82fc-a322df00af2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26e4eede-ff36-4fd4-82fc-a322df00af2b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecc0637a1c9a45091253d25bd20e197d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9631bf43dcd5465bb7b3652efdb945ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cfc2b0a83940be9828934f36636acab97252f1847b06c76730071bef8798c7084007025285c5a24b9eee240d1bce9b5251ab7f18bab3ef666f777a746fd6349', 'id': '26e4eede-ff36-4fd4-82fc-a322df00af2b', 'created_at': datetime.datetime(2026, 6, 23, 18, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26e4eede-ff36-4fd4-82fc-a322df00af2b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e726b9-4dd4-4826-a330-59bfde24fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e726b9-4dd4-4826-a330-59bfde24fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d14a7f-2ccf-431c-aa46-c6f9fff7ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:10 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Volume 4b53d018-8ee3-4e7e-b675-3173ea2272b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0', 'volume_size': 1, 'image_id': '26e4eede-ff36-4fd4-82fc-a322df00af2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26e4eede-ff36-4fd4-82fc-a322df00af2b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecc0637a1c9a45091253d25bd20e197d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9631bf43dcd5465bb7b3652efdb945ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cfc2b0a83940be9828934f36636acab97252f1847b06c76730071bef8798c7084007025285c5a24b9eee240d1bce9b5251ab7f18bab3ef666f777a746fd6349', 'id': '26e4eede-ff36-4fd4-82fc-a322df00af2b', 'created_at': datetime.datetime(2026, 6, 23, 18, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26e4eede-ff36-4fd4-82fc-a322df00af2b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Trying to clone 4b53d018-8ee3-4e7e-b675-3173ea2272b0 from image 26e4eede-ff36-4fd4-82fc-a322df00af2b at location (None, [{'url': 'file:///opt/stack/data/glance/images/26e4eede-ff36-4fd4-82fc-a322df00af2b', 'metadata': {}}]). {{(pid=93739) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 20:34:10 devstack sudo[113190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD Jun 23 20:34:10 devstack sudo[113190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 20:34:10 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Image download 0.00 MB at 0.00 MB/s Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bfadb5-34b3-426b-b6d7-897fc481db48]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:10 devstack sudo[113192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD Jun 23 20:34:10 devstack sudo[113192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:10 devstack sudo[113186]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34" returned: 0 in 0.914s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:10 devstack sudo[113197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff 1G Jun 23 20:34:10 devstack sudo[113197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:10 devstack sudo[113190]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD" returned: 1 in 0.826s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Temporary image d461408e-129e-4b73-9857-660d80200fa2 is fetched for user 6041aaa89db142e881d852f585638530. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fb88d7-cd27-4e6c-8eaf-18a4d7834bb4]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:11 devstack sudo[113192]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:11 devstack sudo[113204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD Jun 23 20:34:11 devstack sudo[113204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:11 devstack sudo[113205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD Jun 23 20:34:11 devstack sudo[113205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (e980f2b7-fd99-4684-ac55-fe74025cc00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb1ca7c-2af6-4b77-8eb8-13368c67caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb1ca7c-2af6-4b77-8eb8-13368c67caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1727185200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370e294b-9215-4b9e-a4c1-f9f8ce64b50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:11Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461b7c83-0db4-499e-9993-285d45baed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461b7c83-0db4-499e-9993-285d45baed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91f68bc-247d-4fe8-9335-b8076825c8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91f68bc-247d-4fe8-9335-b8076825c8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '370e294b-9215-4b9e-a4c1-f9f8ce64b50d', 'volume_name': 'volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e445a5-c34b-4f00-b228-4d9abf900fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e445a5-c34b-4f00-b228-4d9abf900fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71871bae-9609-4e0c-bb62-4faf4706ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:11 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume 370e294b-9215-4b9e-a4c1-f9f8ce64b50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d', 'volume_size': 1} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:11 devstack sudo[113197]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff 1G" returned: 0 in 1.169s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468e74c4-3092-48a0-8322-efefac471c34 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:11 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468e74c4-3092-48a0-8322-efefac471c34 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff Jun 23 20:34:11 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (53385a83-fb5d-4fde-b9eb-9ac1345dab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:12 devstack sudo[113204]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6791f3e7-f41a-4a47-a231-2535e8178d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD" returned: 0 in 1.135s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6791f3e7-f41a-4a47-a231-2535e8178d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-93343981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a52e8df-427b-4413-a04a-a673b124ed03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:12Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414b50c9-0f71-4781-8110-0f3293dbf0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414b50c9-0f71-4781-8110-0f3293dbf0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268cded7-68c8-4018-95ed-754603863067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268cded7-68c8-4018-95ed-754603863067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a52e8df-427b-4413-a04a-a673b124ed03', 'volume_name': 'volume-9a52e8df-427b-4413-a04a-a673b124ed03', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432f96da-b602-4c36-a400-1fcc7ea6dc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432f96da-b602-4c36-a400-1fcc7ea6dc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efeb17f-4eb2-4549-93b1-24f1a45fd661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume 9a52e8df-427b-4413-a04a-a673b124ed03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a52e8df-427b-4413-a04a-a673b124ed03', 'volume_size': 1} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:12 devstack sudo[113205]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD" returned: 1 in 1.227s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Temporary image 26e4eede-ff36-4fd4-82fc-a322df00af2b is fetched for user 82068a69d7c04a089961635734bd5889. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (5f0e0722-f0db-4161-a081-9d964c85242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef888952-6a29-4ce5-b178-dc2f34138362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack sudo[113218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD Jun 23 20:34:12 devstack sudo[113218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef888952-6a29-4ce5-b178-dc2f34138362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984823485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f10ce8-51d2-4025-82f9-8fe7d623603a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:12Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e47cb5d-dcc2-4179-9deb-3aecdfb8d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e47cb5d-dcc2-4179-9deb-3aecdfb8d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91e0b09-9d38-4f17-b880-b7d1461bf38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91e0b09-9d38-4f17-b880-b7d1461bf38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f10ce8-51d2-4025-82f9-8fe7d623603a', 'volume_name': 'volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c387d4-80b7-4beb-ac37-bf88c3f07ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c387d4-80b7-4beb-ac37-bf88c3f07ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff7aba2-25a3-4840-9e89-c23fde02e996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume b6f10ce8-51d2-4025-82f9-8fe7d623603a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a', 'volume_size': 1} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffddc611-2e75-44e8-be13-92b57218974d]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:12 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468e74c4-3092-48a0-8322-efefac471c34 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff" returned: 0 in 0.900s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:12 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff is being set with open permissions: ugo+rw Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:12 devstack sudo[113224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff Jun 23 20:34:12 devstack sudo[113222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD Jun 23 20:34:12 devstack sudo[113222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:12 devstack sudo[113224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (6dc7b2c4-1dfd-4c1c-bdff-af33042f843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45414818-c35d-45c5-b3e1-117c4ec80d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45414818-c35d-45c5-b3e1-117c4ec80d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154805573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5f01fb-1859-4bfc-a46e-67a670d257f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:13Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619c766b-d530-44db-8a86-d52dc6913baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619c766b-d530-44db-8a86-d52dc6913baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e67cb4-3c98-4802-952b-2cedd77592e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e67cb4-3c98-4802-952b-2cedd77592e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5f01fb-1859-4bfc-a46e-67a670d257f1', 'volume_name': 'volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f498290-386d-4bef-8c1c-0d360ab15b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f498290-386d-4bef-8c1c-0d360ab15b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2deeb4-2822-4ed0-8a54-eb837e4e565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:13 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume 3a5f01fb-1859-4bfc-a46e-67a670d257f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1', 'volume_size': 1} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:13 devstack sudo[113218]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD" returned: 1 in 1.232s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (8fa6f959-426c-48ed-a670-f631aa7ad10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f853969e-2893-4708-98cd-db0ebd91fe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f853969e-2893-4708-98cd-db0ebd91fe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596963011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f56cc1-d43e-4c20-87b3-358198e45151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:13Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c03f77b-490c-456a-abed-2d9a83e14fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c03f77b-490c-456a-abed-2d9a83e14fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd80e62d-0207-4756-b1f4-f8ce35e0e5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd80e62d-0207-4756-b1f4-f8ce35e0e5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f56cc1-d43e-4c20-87b3-358198e45151', 'volume_name': 'volume-97f56cc1-d43e-4c20-87b3-358198e45151', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea63787-f3ae-45c5-af93-e88e914de66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea63787-f3ae-45c5-af93-e88e914de66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462de03f-471c-43e3-9214-5d40ed23bae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:13 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume 97f56cc1-d43e-4c20-87b3-358198e45151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f56cc1-d43e-4c20-87b3-358198e45151', 'volume_size': 1} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:13 devstack sudo[113222]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD" returned: 0 in 0.991s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:13 devstack sudo[113232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD Jun 23 20:34:13 devstack sudo[113232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:13 devstack sudo[113224]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff" returned: 0 in 0.986s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:13 devstack sudo[113235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.info Jun 23 20:34:13 devstack sudo[113235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:14 devstack sudo[113232]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD" returned: 1 in 0.783s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:14 devstack sudo[113235]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.info" returned: 0 in 0.669s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:14 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.info is being set with open permissions: ugo+rw Jun 23 20:34:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:14 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.info Jun 23 20:34:14 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:15 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.info" returned: 0 in 0.681s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.431s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.381s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1727185200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370e294b-9215-4b9e-a4c1-f9f8ce64b50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:11Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Creating volume 370e294b-9215-4b9e-a4c1-f9f8ce64b50d {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:15 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:15 devstack sudo[113245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d 1073741824 Jun 23 20:34:15 devstack sudo[113245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-42d4557c-ba27-4f14-ae55-0b358ee12463 tempest-VolumeDependencyTests-368025864 None] Create snapshot completed successfully Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Flow 'volume_create_manager' (ab5aa308-1ad1-4bb4-a2f6-4bc8b00f784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e07a51-ee64-4d6e-a0c4-7f208a89463c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e07a51-ee64-4d6e-a0c4-7f208a89463c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2078710288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2fd846-0efb-4595-8ae8-01d97e219ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6dd611733c488aa1022a2f8d06d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf2d95a0-a13b-415c-b598-fc480e946bff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:16Z,use_quota=True,user_id='13862ce123364b9abc668764c4ad933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689504ef-5067-4ce4-a187-1690e6fee047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689504ef-5067-4ce4-a187-1690e6fee047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36961e1-897a-44ab-8981-dd5e78f2abec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36961e1-897a-44ab-8981-dd5e78f2abec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb2fd846-0efb-4595-8ae8-01d97e219ba7', 'volume_name': 'volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7', 'volume_size': 1, 'snapshot_id': 'bf2d95a0-a13b-415c-b598-fc480e946bff'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eba93e7-2481-4eb1-926b-b3d9c08399c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eba93e7-2481-4eb1-926b-b3d9c08399c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b978e8d-4697-4826-bd2c-0729e2a12b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:15 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Volume cb2fd846-0efb-4595-8ae8-01d97e219ba7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7', 'volume_size': 1, 'snapshot_id': 'bf2d95a0-a13b-415c-b598-fc480e946bff'} Jun 23 20:34:15 devstack sudo[113245]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d 1073741824" returned: 0 in 0.886s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:16 devstack sudo[113251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d Jun 23 20:34:16 devstack sudo[113251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:16 devstack sudo[113251]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d" returned: 0 in 0.632s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.365s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-93343981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a52e8df-427b-4413-a04a-a673b124ed03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:12Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Creating volume 9a52e8df-427b-4413-a04a-a673b124ed03 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:16 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:16 devstack sudo[113254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 1073741824 Jun 23 20:34:16 devstack sudo[113254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71871bae-9609-4e0c-bb62-4faf4706ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e19076e-1e29-4ef7-9ef2-ece8f7e45e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:16 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d (370e294b-9215-4b9e-a4c1-f9f8ce64b50d): created successfully Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e19076e-1e29-4ef7-9ef2-ece8f7e45e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:16 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (e980f2b7-fd99-4684-ac55-fe74025cc00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:16 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f797d003-08ff-41af-8ea7-4c03c32630c6 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created volume successfully. Jun 23 20:34:17 devstack sudo[113254]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 1073741824" returned: 0 in 0.801s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:17 devstack sudo[113260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 Jun 23 20:34:17 devstack sudo[113260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:18 devstack sudo[113260]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03" returned: 0 in 0.647s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.678s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984823485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f10ce8-51d2-4025-82f9-8fe7d623603a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:12Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Creating volume b6f10ce8-51d2-4025-82f9-8fe7d623603a {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:18 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:18 devstack sudo[113263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a 1073741824 Jun 23 20:34:18 devstack sudo[113263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efeb17f-4eb2-4549-93b1-24f1a45fd661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a52e8df-427b-4413-a04a-a673b124ed03', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061c421e-8a05-45d1-96c6-2eae0254b75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:18 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume volume-9a52e8df-427b-4413-a04a-a673b124ed03 (9a52e8df-427b-4413-a04a-a673b124ed03): created successfully Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061c421e-8a05-45d1-96c6-2eae0254b75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (53385a83-fb5d-4fde-b9eb-9ac1345dab30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:18 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-54eafeed-323c-441b-9788-780a4c7d126a tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created volume successfully. Jun 23 20:34:18 devstack sudo[113263]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a 1073741824" returned: 0 in 0.820s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:19 devstack sudo[113268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a Jun 23 20:34:19 devstack sudo[113268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:19 devstack sudo[113268]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a" returned: 0 in 0.636s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.629s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154805573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5f01fb-1859-4bfc-a46e-67a670d257f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:13Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Creating volume 3a5f01fb-1859-4bfc-a46e-67a670d257f1 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:19 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff7aba2-25a3-4840-9e89-c23fde02e996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c1b2a7-b382-4082-b3cd-62434359565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:19 devstack sudo[113271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 1073741824 Jun 23 20:34:19 devstack sudo[113271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:19 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a (b6f10ce8-51d2-4025-82f9-8fe7d623603a): created successfully Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c1b2a7-b382-4082-b3cd-62434359565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:19 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (5f0e0722-f0db-4161-a081-9d964c85242b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:19 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-dc3187da-f08e-497b-b139-5f5aa89082b3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created volume successfully. Jun 23 20:34:20 devstack sudo[113271]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 1073741824" returned: 0 in 0.837s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:20 devstack sudo[113277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 Jun 23 20:34:20 devstack sudo[113277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:21 devstack sudo[113277]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1" returned: 0 in 0.653s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.831s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e18c90-1f72-44c0-a427-92503c388ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f253f6a086d405185149f74a22c14a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:08Z,use_quota=True,user_id='6041aaa89db142e881d852f585638530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Creating volume 28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:21 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2deeb4-2822-4ed0-8a54-eb837e4e565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:21 devstack sudo[113280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 1073741824 Jun 23 20:34:21 devstack sudo[113280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf120a16-4342-42a9-8785-f74604e8f701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:21 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 (3a5f01fb-1859-4bfc-a46e-67a670d257f1): created successfully Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf120a16-4342-42a9-8785-f74604e8f701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (6dc7b2c4-1dfd-4c1c-bdff-af33042f843a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:21 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a4b2270d-f086-4c95-aadb-1fd7be9452c3 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created volume successfully. Jun 23 20:34:22 devstack sudo[113280]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 1073741824" returned: 0 in 0.811s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:22 devstack sudo[113286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 Jun 23 20:34:22 devstack sudo[113286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:22 devstack sudo[113286]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7" returned: 0 in 0.642s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.210s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596963011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f56cc1-d43e-4c20-87b3-358198e45151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c69ff054043249ad3d1003d3c682f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:13Z,use_quota=True,user_id='1d502abfb8fb496ebc5fe6fc0aeb0371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Creating volume 97f56cc1-d43e-4c20-87b3-358198e45151 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:22 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:22 devstack sudo[113291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 1073741824 Jun 23 20:34:22 devstack sudo[113291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Attempting download of d461408e-129e-4b73-9857-660d80200fa2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d461408e-129e-4b73-9857-660d80200fa2', 'metadata': {}}])) to volume 28e18c90-1f72-44c0-a427-92503c388ec7. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d37375a-46e2-48a2-ba7a-757d66383d12]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d461408e-129e-4b73-9857-660d80200fa2_j5a8_4wm {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:22 devstack sudo[113293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d461408e-129e-4b73-9857-660d80200fa2_j5a8_4wm Jun 23 20:34:22 devstack sudo[113293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:23 devstack sudo[113293]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d461408e-129e-4b73-9857-660d80200fa2_j5a8_4wm" returned: 0 in 0.732s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d461408e-129e-4b73-9857-660d80200fa2_j5a8_4wm {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:23 devstack sudo[113291]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 1073741824" returned: 0 in 0.856s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:23 devstack sudo[113301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d461408e-129e-4b73-9857-660d80200fa2_j5a8_4wm Jun 23 20:34:23 devstack sudo[113301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:23 devstack sudo[113302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 Jun 23 20:34:23 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:24 devstack sudo[113301]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d461408e-129e-4b73-9857-660d80200fa2_j5a8_4wm" returned: 1 in 0.722s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d461408e-129e-4b73-9857-660d80200fa2_j5a8_4wm' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f2a2a1-dc98-4768-8b32-e67ed4c4fa29]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:24 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151" returned: 0 in 0.659s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.981s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b53d018-8ee3-4e7e-b675-3173ea2272b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631bf43dcd5465bb7b3652efdb945ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:10Z,use_quota=True,user_id='82068a69d7c04a089961635734bd5889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7ec61b9-0b99-4e2a-9850-69f3d1789f30),volume_type_id=c7ec61b9-0b99-4e2a-9850-69f3d1789f30)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Creating volume 4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:24 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462de03f-471c-43e3-9214-5d40ed23bae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f56cc1-d43e-4c20-87b3-358198e45151', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:24 devstack sudo[113309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 1073741824 Jun 23 20:34:24 devstack sudo[113309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de482afa-b19f-4cad-ab01-95ca751947ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:24 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Volume volume-97f56cc1-d43e-4c20-87b3-358198e45151 (97f56cc1-d43e-4c20-87b3-358198e45151): created successfully Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de482afa-b19f-4cad-ab01-95ca751947ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Flow 'volume_create_manager' (8fa6f959-426c-48ed-a670-f631aa7ad10c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:24 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f536b331-20d4-4af6-83a0-8710b2af45ac tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created volume successfully. Jun 23 20:34:24 devstack sudo[113308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD Jun 23 20:34:24 devstack sudo[113308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:24 devstack sudo[113308]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:25 devstack sudo[113319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD Jun 23 20:34:25 devstack sudo[113319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:25 devstack sudo[113309]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 1073741824" returned: 0 in 0.948s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-97f56cc1-d43e-4c20-87b3-358198e45151-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-97f56cc1-d43e-4c20-87b3-358198e45151-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:25 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 Jun 23 20:34:25 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-quobyte-97f56cc1-d43e-4c20-87b3-358198e45151" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-97f56cc1-d43e-4c20-87b3-358198e45151" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[03151d09-2933-4cab-8b04-8dcb0b1e9166]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:25 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 Jun 23 20:34:25 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:25 devstack sudo[113319]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD" returned: 1 in 0.814s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] d461408e-129e-4b73-9857-660d80200fa2 was raw, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:25 devstack sudo[113329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 Jun 23 20:34:25 devstack sudo[113329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:25 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0" returned: 0 in 0.717s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:25 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.026s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-quobyte-bf2d95a0-a13b-415c-b598-fc480e946bff-cb2fd846-0efb-4595-8ae8-01d97e219ba7" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-bf2d95a0-a13b-415c-b598-fc480e946bff-cb2fd846-0efb-4595-8ae8-01d97e219ba7" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Creating volume cb2fd846-0efb-4595-8ae8-01d97e219ba7 from snapshot bf2d95a0-a13b-415c-b598-fc480e946bff {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-quobyte-cb2fd846-0efb-4595-8ae8-01d97e219ba7" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Attempting download of 26e4eede-ff36-4fd4-82fc-a322df00af2b ((None, [{'url': 'file:///opt/stack/data/glance/images/26e4eede-ff36-4fd4-82fc-a322df00af2b', 'metadata': {}}])) to volume 4b53d018-8ee3-4e7e-b675-3173ea2272b0. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-cb2fd846-0efb-4595-8ae8-01d97e219ba7" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] snapshot: bf2d95a0-a13b-415c-b598-fc480e946bff, volume: cb2fd846-0efb-4595-8ae8-01d97e219ba7, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[60da72ae-54c3-4671-91ef-cd8ad6c17f3c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ebab5b-8dd1-4eec-abae-676fc059aa65]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26e4eede-ff36-4fd4-82fc-a322df00af2b_frfrm7q_ {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:26 devstack sudo[113337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26e4eede-ff36-4fd4-82fc-a322df00af2b_frfrm7q_ Jun 23 20:34:26 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:26 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff Jun 23 20:34:26 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:26 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151" returned: 0 in 0.889s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:26 devstack sudo[113340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151 Jun 23 20:34:26 devstack sudo[113340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:26 devstack sudo[113329]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7" returned: 0 in 1.006s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d461408e-129e-4b73-9857-660d80200fa2_x0ei07ijdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:34:26 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:26 devstack sudo[113345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 1G Jun 23 20:34:26 devstack sudo[113345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:26 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26e4eede-ff36-4fd4-82fc-a322df00af2b_frfrm7q_" returned: 0 in 0.789s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:26 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26e4eede-ff36-4fd4-82fc-a322df00af2b_frfrm7q_ {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:27 devstack sudo[113351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26e4eede-ff36-4fd4-82fc-a322df00af2b_frfrm7q_ Jun 23 20:34:27 devstack sudo[113351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:27 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff" returned: 0 in 0.978s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-468e74c4-3092-48a0-8322-efefac471c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3a23db-4caa-4ebe-8c3e-14f2d22a072c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:27 devstack sudo[113340]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-97f56cc1-d43e-4c20-87b3-358198e45151" returned: 0 in 0.894s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-97f56cc1-d43e-4c20-87b3-358198e45151" released by "delete_volume" :: held 1.829s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:27 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 Jun 23 20:34:27 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created reservations ['87857730-1edd-48ed-a1c5-199f2ace5f2b', 'e834f593-226b-49ac-828a-8eede058c612', 'c6ceede5-f3a7-4a69-bc16-aabb71bb6fab', 'e8e9d4e2-5cad-451f-ad7c-31bc8de02ca0'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:27 devstack sudo[113358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:27 devstack sudo[113358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-3a5f01fb-1859-4bfc-a46e-67a670d257f1-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:27 devstack sudo[113345]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 1G" returned: 0 in 1.018s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-3a5f01fb-1859-4bfc-a46e-67a670d257f1-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:27 devstack sudo[113351]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26e4eede-ff36-4fd4-82fc-a322df00af2b_frfrm7q_" returned: 1 in 0.923s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26e4eede-ff36-4fd4-82fc-a322df00af2b_frfrm7q_' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ecfd9d-3e6e-4d6a-9782-1a8549c3cd2e]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8253606-c3fa-49a5-9898-bd3a5a57079d]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-quobyte-3a5f01fb-1859-4bfc-a46e-67a670d257f1" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-3a5f01fb-1859-4bfc-a46e-67a670d257f1" acquired by "delete_volume" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[508f3682-79bf-4d3a-91b0-810dcc76e2c2]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:27 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:28 devstack sudo[113368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 Jun 23 20:34:28 devstack sudo[113368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:28 devstack sudo[113369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD Jun 23 20:34:28 devstack sudo[113369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:28 devstack sudo[113370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 Jun 23 20:34:28 devstack sudo[113370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:28 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34" returned: 0 in 1.001s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:28 devstack sudo[113374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 Jun 23 20:34:28 devstack sudo[113374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:28 devstack sudo[113358]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.040s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:28 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Deleted volume successfully. Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ad2f4f90-548e-4a3a-a1ce-5754d65f26a1 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-97f56cc1-d43e-4c20-87b3-358198e45151-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:28 devstack sudo[113368]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7" returned: 0 in 0.992s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:28 devstack sudo[113370]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1" returned: 0 in 0.940s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:28 devstack sudo[113387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1 Jun 23 20:34:28 devstack sudo[113387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:28 devstack sudo[113369]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD" returned: 0 in 1.054s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:29 devstack sudo[113385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 Jun 23 20:34:29 devstack sudo[113385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:29 devstack sudo[113390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD Jun 23 20:34:29 devstack sudo[113390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:30 devstack sudo[113387]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-3a5f01fb-1859-4bfc-a46e-67a670d257f1" returned: 0 in 1.432s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-3a5f01fb-1859-4bfc-a46e-67a670d257f1" released by "delete_volume" :: held 2.442s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created reservations ['1c4fc6fe-ab38-4b65-9b8a-6a4b70bdd25f', 'b7cf743e-49be-42fd-9ac4-ea894d35c16f', '76dd6aac-fd3d-4c2c-b3ef-3eda05aeff6e', 'deda0bee-74d2-4f83-9f6c-3fd91ac53335'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:30 devstack sudo[113404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:30 devstack sudo[113404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:30 devstack sudo[113390]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD" returned: 1 in 2.013s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:30 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] 26e4eede-ff36-4fd4-82fc-a322df00af2b was raw, converting to raw {{(pid=93739) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 20:34:30 devstack sudo[113385]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7" returned: 1 in 2.146s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Downloaded image d461408e-129e-4b73-9857-660d80200fa2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d461408e-129e-4b73-9857-660d80200fa2', 'metadata': {}}])) to volume 28e18c90-1f72-44c0-a427-92503c388ec7 successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Temporary image d461408e-129e-4b73-9857-660d80200fa2 for user 6041aaa89db142e881d852f585638530 is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Marking volume 28e18c90-1f72-44c0-a427-92503c388ec7 as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Copying metadata from image d461408e-129e-4b73-9857-660d80200fa2 to 28e18c90-1f72-44c0-a427-92503c388ec7. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Creating volume glance metadata for volume 28e18c90-1f72-44c0-a427-92503c388ec7 backed by image d461408e-129e-4b73-9857-660d80200fa2 with: {'image_id': 'd461408e-129e-4b73-9857-660d80200fa2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'be776089c1579457c3daac69d7397ee1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:34:31 devstack sudo[113409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 Jun 23 20:34:31 devstack sudo[113409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe4c27c-ed62-46fa-b45c-0d592ae40a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e18c90-1f72-44c0-a427-92503c388ec7', 'volume_size': 1, 'image_id': 'd461408e-129e-4b73-9857-660d80200fa2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d461408e-129e-4b73-9857-660d80200fa2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be776089c1579457c3daac69d7397ee1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f253f6a086d405185149f74a22c14a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cd0712be76f99eb68c33d832c5bcdca89a81dbc9fedfa06af8f42a9609ca83974ee65e9a0d8dd4b9cb7cb547381b828a24c1a3f9b2dbbe1121709bfb87eb90c', 'id': 'd461408e-129e-4b73-9857-660d80200fa2', 'created_at': datetime.datetime(2026, 6, 23, 18, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d461408e-129e-4b73-9857-660d80200fa2/file', 'properties': {}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7664581e-37c3-4b78-9e6e-fe41f6fd9888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:31 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Volume volume-28e18c90-1f72-44c0-a427-92503c388ec7 (28e18c90-1f72-44c0-a427-92503c388ec7): created successfully Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7664581e-37c3-4b78-9e6e-fe41f6fd9888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Flow 'volume_create_manager' (ba572fa6-ad6c-4239-a128-5d5bccc76cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:31 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fdbb42c9-28fd-4da0-b488-e8c060eb5130 tempest-VolumeImageDependencyTests-971998170 None] Created volume successfully. Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-b6f10ce8-51d2-4025-82f9-8fe7d623603a-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-b6f10ce8-51d2-4025-82f9-8fe7d623603a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-quobyte-b6f10ce8-51d2-4025-82f9-8fe7d623603a" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-b6f10ce8-51d2-4025-82f9-8fe7d623603a" acquired by "delete_volume" :: waited 0.068s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[caff0ce9-9891-44ff-9686-cf10b7da5831]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:32 devstack sudo[113446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a Jun 23 20:34:32 devstack sudo[113446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:32 devstack sudo[113404]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.705s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:32 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:32 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Deleted volume successfully. Jun 23 20:34:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc63cb8b-8338-4424-b465-012d25686cbc tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-3a5f01fb-1859-4bfc-a46e-67a670d257f1-delete_volume" released by "delete_volume" :: held 4.618s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Acquiring lock "cinder-28e18c90-1f72-44c0-a427-92503c388ec7-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Lock "cinder-28e18c90-1f72-44c0-a427-92503c388ec7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Acquiring lock "cinder-quobyte-28e18c90-1f72-44c0-a427-92503c388ec7" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:32 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Lock "cinder-quobyte-28e18c90-1f72-44c0-a427-92503c388ec7" acquired by "delete_volume" :: waited 0.041s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:33 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f51d5dc-8938-4719-a8ea-f7927936bb73]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:33 devstack sudo[113454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 Jun 23 20:34:33 devstack sudo[113454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:33 devstack sudo[113409]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0" returned: 0 in 2.464s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:33 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26e4eede-ff36-4fd4-82fc-a322df00af2b_rtgh3ynpdevstack@QuobyteHD, size 0.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:34:33 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 20:34:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:33 devstack sudo[113457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 1G Jun 23 20:34:33 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:34 devstack sudo[113446]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a" returned: 0 in 2.891s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:34 devstack sudo[113454]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7" returned: 0 in 1.794s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:34 devstack sudo[113465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a Jun 23 20:34:34 devstack sudo[113465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:34 devstack sudo[113374]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7" returned: 0 in 6.818s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:34 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d26e02-ca33-46b2-916a-9885b35d3d07]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:35 devstack sudo[113466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 Jun 23 20:34:35 devstack sudo[113466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:35 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 1G" returned: 0 in 1.613s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:35 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 Jun 23 20:34:35 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e49d087-9acc-41f0-b124-d998cbfd5564]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:35 devstack sudo[113474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 Jun 23 20:34:35 devstack sudo[113474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:35 devstack sudo[113465]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-b6f10ce8-51d2-4025-82f9-8fe7d623603a" returned: 0 in 0.760s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-b6f10ce8-51d2-4025-82f9-8fe7d623603a" released by "delete_volume" :: held 3.762s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created reservations ['c788e64f-3833-416c-b588-c506094ca727', 'b340ff84-6b1f-45d8-8274-1a3ead426d64', 'e6b5d91a-4d24-4ea0-a2f1-0f4e99447ae6', '074ea81e-c8c1-48dd-bd9f-ffe6079b68c4'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:35 devstack sudo[113466]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7" returned: 1 in 0.917s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:35 devstack sudo[113482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7 Jun 23 20:34:35 devstack sudo[113482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:35 devstack sudo[113484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:35 devstack sudo[113484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:36 devstack sudo[113474]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0" returned: 0 in 0.901s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:36 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34" returned: 0 in 1.137s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:34:36 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Converted 1024.00 MB image at 150.14 MB/s Jun 23 20:34:36 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 is being set with open permissions: ugo+rw Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:36 devstack sudo[113491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 Jun 23 20:34:36 devstack sudo[113491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:36 devstack sudo[113490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 Jun 23 20:34:36 devstack sudo[113490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-9a52e8df-427b-4413-a04a-a673b124ed03-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-9a52e8df-427b-4413-a04a-a673b124ed03-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:36 devstack sudo[113482]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-quobyte-9a52e8df-427b-4413-a04a-a673b124ed03" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:36 devstack sudo[113484]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-28e18c90-1f72-44c0-a427-92503c388ec7" returned: 0 in 0.825s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.790s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:36 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Deleted volume successfully. Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-9a52e8df-427b-4413-a04a-a673b124ed03" acquired by "delete_volume" :: waited 0.051s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Lock "cinder-quobyte-28e18c90-1f72-44c0-a427-92503c388ec7" released by "delete_volume" :: held 3.704s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2234728-20f0-4677-87a4-3c3e20b3c145]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-78825d40-1643-416b-a360-31f2ef5220ce tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-b6f10ce8-51d2-4025-82f9-8fe7d623603a-delete_volume" released by "delete_volume" :: held 5.064s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Created reservations ['00455707-a803-405b-965d-93476d3dc91f', '36f9e8e3-6257-4950-9890-4bce6ecdd5a5', 'a95389f3-309d-4256-8739-db0425b06fea', '45a2733c-14f6-4a81-95f0-1a8fea017b3e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:36 devstack sudo[113496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 Jun 23 20:34:36 devstack sudo[113496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:36 devstack sudo[113499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:36 devstack sudo[113499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:37 devstack sudo[113490]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0" returned: 1 in 1.036s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Downloaded image 26e4eede-ff36-4fd4-82fc-a322df00af2b ((None, [{'url': 'file:///opt/stack/data/glance/images/26e4eede-ff36-4fd4-82fc-a322df00af2b', 'metadata': {}}])) to volume 4b53d018-8ee3-4e7e-b675-3173ea2272b0 successfully. {{(pid=93739) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Temporary image 26e4eede-ff36-4fd4-82fc-a322df00af2b for user 82068a69d7c04a089961635734bd5889 is deleted. {{(pid=93739) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.volume_utils [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Marking volume 4b53d018-8ee3-4e7e-b675-3173ea2272b0 as bootable. {{(pid=93739) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Copying metadata from image 26e4eede-ff36-4fd4-82fc-a322df00af2b to 4b53d018-8ee3-4e7e-b675-3173ea2272b0. {{(pid=93739) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Creating volume glance metadata for volume 4b53d018-8ee3-4e7e-b675-3173ea2272b0 backed by image 26e4eede-ff36-4fd4-82fc-a322df00af2b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '26e4eede-ff36-4fd4-82fc-a322df00af2b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ecc0637a1c9a45091253d25bd20e197d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93739) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 20:34:37 devstack sudo[113491]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7" returned: 0 in 0.990s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-cb2fd846-0efb-4595-8ae8-01d97e219ba7" released by "_copy_volume_from_snapshot" :: held 11.056s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-bf2d95a0-a13b-415c-b598-fc480e946bff-cb2fd846-0efb-4595-8ae8-01d97e219ba7" released by "_create_volume_from_snapshot" :: held 11.108s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.143s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b978e8d-4697-4826-bd2c-0729e2a12b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7', 'volume_size': 1, 'snapshot_id': 'bf2d95a0-a13b-415c-b598-fc480e946bff'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e372ed-b43f-45b4-8c4a-d4cceee8a112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Volume volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 (cb2fd846-0efb-4595-8ae8-01d97e219ba7): created successfully Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e372ed-b43f-45b4-8c4a-d4cceee8a112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Flow 'volume_create_manager' (ab5aa308-1ad1-4bb4-a2f6-4bc8b00f784b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d14a7f-2ccf-431c-aa46-c6f9fff7ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0', 'volume_size': 1, 'image_id': '26e4eede-ff36-4fd4-82fc-a322df00af2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26e4eede-ff36-4fd4-82fc-a322df00af2b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecc0637a1c9a45091253d25bd20e197d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9631bf43dcd5465bb7b3652efdb945ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9cfc2b0a83940be9828934f36636acab97252f1847b06c76730071bef8798c7084007025285c5a24b9eee240d1bce9b5251ab7f18bab3ef666f777a746fd6349', 'id': '26e4eede-ff36-4fd4-82fc-a322df00af2b', 'created_at': datetime.datetime(2026, 6, 23, 18, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 18, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26e4eede-ff36-4fd4-82fc-a322df00af2b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d424421-2190-4876-87e8-c10f38956f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-2bcc3203-f1cc-41e0-b5bf-2cb979b6a93d tempest-VolumeDependencyTests-368025864 None] Created volume successfully. Jun 23 20:34:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Volume volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 (4b53d018-8ee3-4e7e-b675-3173ea2272b0): created successfully Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d424421-2190-4876-87e8-c10f38956f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Flow 'volume_create_manager' (c3c3cfa3-b4fc-4d6b-8f93-13687dad00fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ab79b9c4-48c5-40de-8a95-c6b03b4782a3 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Created volume successfully. Jun 23 20:34:37 devstack sudo[113499]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.670s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Deleted volume successfully. Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-ca8e5414-4d63-4dcd-8bc6-13ff21354606 tempest-VolumeImageDependencyTests-971998170 None] Lock "cinder-28e18c90-1f72-44c0-a427-92503c388ec7-delete_volume" released by "delete_volume" :: held 4.760s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:37 devstack sudo[113496]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03" returned: 0 in 0.950s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:37 devstack sudo[113508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03 Jun 23 20:34:37 devstack sudo[113508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-bf2d95a0-a13b-415c-b598-fc480e946bff-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Lock "cinder-bf2d95a0-a13b-415c-b598-fc480e946bff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-quobyte-468e74c4-3092-48a0-8322-efefac471c34" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-468e74c4-3092-48a0-8322-efefac471c34" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-quobyte-bf2d95a0-a13b-415c-b598-fc480e946bff" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-bf2d95a0-a13b-415c-b598-fc480e946bff" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Deleting offline snapshot bf2d95a0-a13b-415c-b598-fc480e946bff of volume 468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] snapshot_file for this snap is: volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1353fcdb-dc38-4b5b-a972-fd15e6c3c217]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Acquiring lock "cinder-4b53d018-8ee3-4e7e-b675-3173ea2272b0-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:38 devstack sudo[113510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff Jun 23 20:34:38 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "cinder-4b53d018-8ee3-4e7e-b675-3173ea2272b0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:38 devstack sudo[113508]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9a52e8df-427b-4413-a04a-a673b124ed03" returned: 0 in 0.723s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-9a52e8df-427b-4413-a04a-a673b124ed03" released by "delete_volume" :: held 1.727s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Acquiring lock "cinder-quobyte-4b53d018-8ee3-4e7e-b675-3173ea2272b0" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "cinder-quobyte-4b53d018-8ee3-4e7e-b675-3173ea2272b0" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4defd837-c800-4ae9-b4ca-1ac7cda9563d]: (4, 'raw') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created reservations ['fea9dabb-e29a-4a78-9d09-c7e5a5bb9145', '098ae79c-34a5-4489-88fd-ce3869ac7ed1', '05e7ba86-c1e3-4e46-9120-a6657d9da705', '863234c4-2b05-45ab-879e-f8081163424a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:38 devstack sudo[113513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 Jun 23 20:34:38 devstack sudo[113513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:38 devstack sudo[113515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:38 devstack sudo[113515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-370e294b-9215-4b9e-a4c1-f9f8ce64b50d-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-370e294b-9215-4b9e-a4c1-f9f8ce64b50d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-quobyte-370e294b-9215-4b9e-a4c1-f9f8ce64b50d" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-370e294b-9215-4b9e-a4c1-f9f8ce64b50d" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[df525491-b710-4f6b-baeb-cb66cd2e1ca6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:39 devstack sudo[113522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d Jun 23 20:34:39 devstack sudo[113522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:39 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff" returned: 0 in 1.238s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-468e74c4-3092-48a0-8322-efefac471c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[66774a99-c25a-4231-98d5-29f02d6fd292]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0" returned: 0 in 1.145s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:39 devstack sudo[113513]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:39 devstack sudo[113515]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.020s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:39 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Deleted volume successfully. Jun 23 20:34:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fb500bc7-5d74-493c-b2e5-a417ae3a6b7b tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-9a52e8df-427b-4413-a04a-a673b124ed03-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:39 devstack sudo[113527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 Jun 23 20:34:39 devstack sudo[113527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:39 devstack sudo[113528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 Jun 23 20:34:39 devstack sudo[113528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:40 devstack sudo[113522]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d" returned: 0 in 1.006s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:40 devstack sudo[113534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d Jun 23 20:34:40 devstack sudo[113534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:40 devstack sudo[113527]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34" returned: 0 in 1.064s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:40 devstack sudo[113528]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0" returned: 1 in 0.954s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0' failed. Not Retrying. {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:40 devstack sudo[113544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff Jun 23 20:34:40 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:40 devstack sudo[113546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0 Jun 23 20:34:40 devstack sudo[113546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:40 devstack sudo[113534]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-370e294b-9215-4b9e-a4c1-f9f8ce64b50d" returned: 0 in 0.849s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-370e294b-9215-4b9e-a4c1-f9f8ce64b50d" released by "delete_volume" :: held 1.916s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created reservations ['db86be39-35c7-44f3-886c-61ddd79405f5', 'eec10db1-c13f-447d-b5a6-e97b7aa0101a', 'bf354e79-6866-4823-8561-542bb5433a05', '6024fa8e-42b7-4bd1-92b0-3bd1dcbd2cbe'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:41 devstack sudo[113549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:41 devstack sudo[113549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-2a707662-7c13-415d-bf3d-ace0a6516c95-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-2a707662-7c13-415d-bf3d-ace0a6516c95-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "cinder-quobyte-2a707662-7c13-415d-bf3d-ace0a6516c95" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-2a707662-7c13-415d-bf3d-ace0a6516c95" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:41 devstack sudo[113546]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-4b53d018-8ee3-4e7e-b675-3173ea2272b0" returned: 0 in 0.895s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[554131e8-b7f6-43e5-95fb-a0e026ec3fd8]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "cinder-quobyte-4b53d018-8ee3-4e7e-b675-3173ea2272b0" released by "delete_volume" :: held 3.088s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:41 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff" returned: 0 in 1.046s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Created reservations ['55be587b-5296-4ae0-9ab8-0ff0c94d46ab', '74862451-5181-46ad-9946-e43bcdc8fc57', '8063a35c-34d5-4e94-891c-298a70ca9c0a', '2c6b3dec-f8d3-4805-a6fd-850e38d26c44'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:41 devstack sudo[113557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff Jun 23 20:34:41 devstack sudo[113557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:41 devstack sudo[113556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 Jun 23 20:34:41 devstack sudo[113556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:41 devstack sudo[113560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:41 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Flow 'volume_create_manager' (43a6b586-ccc7-4bed-89f4-1b0d2d7ed382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8668c45-a505-4c71-a577-e233c5deb82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8668c45-a505-4c71-a577-e233c5deb82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829235c38c434df78fe9477c26541350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:42Z,use_quota=True,user_id='deeb9cad292d4a3892e2bbe29fb1f41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f105b722-7e70-49a7-a290-c5710586ea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f105b722-7e70-49a7-a290-c5710586ea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52443bdb-2796-4046-abce-ac4ea3feaa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52443bdb-2796-4046-abce-ac4ea3feaa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870', 'volume_name': 'volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99afe512-612e-4c50-950f-fca3bc624ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99afe512-612e-4c50-950f-fca3bc624ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9507194-0761-4ad1-9203-6765869e16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:42 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Volume 5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870', 'volume_size': 1} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829235c38c434df78fe9477c26541350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:42Z,use_quota=True,user_id='deeb9cad292d4a3892e2bbe29fb1f41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Creating volume 5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:42 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:42 devstack sudo[113564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 1073741824 Jun 23 20:34:42 devstack sudo[113564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:42 devstack sudo[113557]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34.bf2d95a0-a13b-415c-b598-fc480e946bff" returned: 0 in 0.791s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:42 devstack sudo[113549]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.321s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-bf2d95a0-a13b-415c-b598-fc480e946bff" released by "_delete_snapshot" :: held 4.338s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Deleted volume successfully. Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-468e74c4-3092-48a0-8322-efefac471c34" released by "delete_snapshot" :: held 4.388s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-e0a68281-af9b-4ed7-ac32-8298206df394 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-370e294b-9215-4b9e-a4c1-f9f8ce64b50d-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Created reservations ['c4ad70e7-c79c-4ffb-8335-94664d1a19f5', '30fefda5-9150-43e7-b0dd-fdeebc83c07c', '051ffe6b-8b39-4e9c-9d59-b1b850acc6b6', '9cab0db4-f5ff-4fe4-85b8-783502dc26ab'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Delete snapshot completed successfully. Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cbbdfa01-1946-4e7f-96d1-46eff1fffd48 tempest-VolumeDependencyTests-368025864 None] Lock "cinder-bf2d95a0-a13b-415c-b598-fc480e946bff-delete_snapshot" released by "delete_snapshot" :: held 4.671s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:42 devstack sudo[113556]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95" returned: 0 in 1.342s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:42 devstack sudo[113570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95 Jun 23 20:34:42 devstack sudo[113570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:42 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.215s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Deleted volume successfully. Jun 23 20:34:42 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-316ad629-8226-4708-9fdd-09087d1dde19 tempest-VolumeAndVolumeTypeFromImageTest-1270811711 None] Lock "cinder-4b53d018-8ee3-4e7e-b675-3173ea2272b0-delete_volume" released by "delete_volume" :: held 4.658s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:43 devstack sudo[113564]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 1073741824" returned: 0 in 1.097s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:43 devstack sudo[113576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 Jun 23 20:34:43 devstack sudo[113576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-468e74c4-3092-48a0-8322-efefac471c34-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Lock "cinder-468e74c4-3092-48a0-8322-efefac471c34-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-quobyte-468e74c4-3092-48a0-8322-efefac471c34" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:43 devstack sudo[113570]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-2a707662-7c13-415d-bf3d-ace0a6516c95" returned: 0 in 0.789s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-468e74c4-3092-48a0-8322-efefac471c34" acquired by "delete_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-quobyte-2a707662-7c13-415d-bf3d-ace0a6516c95" released by "delete_volume" :: held 2.254s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaa61f1-4488-4874-85e3-d5f1199a023b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Created reservations ['38181d19-8527-4f17-a1dc-1528b04baa00', '8a0c7f3e-0e60-4ce4-bb22-e189c3b21515', '959d0f4d-0b79-4616-852a-91ea4f90aa6c', 'd0b1ad21-ec3f-4859-8e7a-61abb756964a'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:43 devstack sudo[113579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 Jun 23 20:34:43 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:43 devstack sudo[113580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:43 devstack sudo[113580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:44 devstack sudo[113576]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870" returned: 0 in 0.924s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9507194-0761-4ad1-9203-6765869e16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525658ca-43b8-48a2-a132-a7f6a2196dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:44 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Volume volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 (5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870): created successfully Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525658ca-43b8-48a2-a132-a7f6a2196dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Flow 'volume_create_manager' (43a6b586-ccc7-4bed-89f4-1b0d2d7ed382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:44 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f82bd209-b20d-437c-9c61-4b21168356ea tempest-CinderUnicodeTest-815795262 None] Created volume successfully. Jun 23 20:34:44 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34" returned: 0 in 0.992s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:44 devstack sudo[113580]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.830s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:44 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Deleted volume successfully. Jun 23 20:34:44 devstack sudo[113589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34 Jun 23 20:34:44 devstack sudo[113589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:44 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-3bef085d-cd7e-4a5a-bc16-1f5a2d641a13 tempest-CreateVolumesFromSourceVolumeTest-1888859238 None] Lock "cinder-2a707662-7c13-415d-bf3d-ace0a6516c95-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:45 devstack sudo[113589]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-468e74c4-3092-48a0-8322-efefac471c34" returned: 0 in 0.741s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-468e74c4-3092-48a0-8322-efefac471c34" released by "delete_volume" :: held 1.841s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Created reservations ['1d2c4af8-e7e1-4364-aefa-589968d72e8a', '0d9dc073-9a99-4375-bfea-92c019fb5ca2', '75d08395-904f-4a0f-b389-5c33e1ff941c', '9c1e604d-7a67-46b4-b253-ed235241d43f'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:45 devstack sudo[113592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:45 devstack sudo[113592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-cb2fd846-0efb-4595-8ae8-01d97e219ba7-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Lock "cinder-cb2fd846-0efb-4595-8ae8-01d97e219ba7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Acquiring lock "cinder-quobyte-cb2fd846-0efb-4595-8ae8-01d97e219ba7" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-cb2fd846-0efb-4595-8ae8-01d97e219ba7" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Flow 'volume_create_manager' (58bdb470-fc65-4961-b7f8-caab23fcae59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba36c75-fac4-4787-b413-5244d0c878b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d838d-0026-462b-a4c3-9ff9224afcc5]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba36c75-fac4-4787-b413-5244d0c878b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-833829305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e15313-3475-4f55-8faa-bce1b1ae9476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829235c38c434df78fe9477c26541350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:46Z,use_quota=True,user_id='deeb9cad292d4a3892e2bbe29fb1f41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08c7a27-30a2-47cf-9111-3cdeab7f9081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08c7a27-30a2-47cf-9111-3cdeab7f9081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da418761-95dc-4fe3-a0c2-9e3bf5a8dc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da418761-95dc-4fe3-a0c2-9e3bf5a8dc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e15313-3475-4f55-8faa-bce1b1ae9476', 'volume_name': 'volume-37e15313-3475-4f55-8faa-bce1b1ae9476', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224f0d03-9d2d-4514-a64d-bd8c3fdb3bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224f0d03-9d2d-4514-a64d-bd8c3fdb3bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd680f8c-9752-4e41-8220-b09a0f000a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:46 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Volume 37e15313-3475-4f55-8faa-bce1b1ae9476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e15313-3475-4f55-8faa-bce1b1ae9476', 'volume_size': 1} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-833829305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e15313-3475-4f55-8faa-bce1b1ae9476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829235c38c434df78fe9477c26541350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:46Z,use_quota=True,user_id='deeb9cad292d4a3892e2bbe29fb1f41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Creating volume 37e15313-3475-4f55-8faa-bce1b1ae9476 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:46 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:46 devstack sudo[113595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 1073741824 Jun 23 20:34:46 devstack sudo[113595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:46 devstack sudo[113594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 Jun 23 20:34:46 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:46 devstack sudo[113598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:46 devstack sudo[113598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:47 devstack sudo[113592]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.415s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:47 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Deleted volume successfully. Jun 23 20:34:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-eb106a4f-9707-465a-b9dc-5e5cc1b58c6a tempest-VolumeDependencyTests-368025864 None] Lock "cinder-468e74c4-3092-48a0-8322-efefac471c34-delete_volume" released by "delete_volume" :: held 3.723s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:47 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7" returned: 0 in 1.200s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:47 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7 Jun 23 20:34:47 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:47 devstack sudo[113595]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 1073741824" returned: 0 in 1.662s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:47 devstack sudo[113610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 Jun 23 20:34:47 devstack sudo[113610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:48 devstack sudo[113598]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.262s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:34:48 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-cb2fd846-0efb-4595-8ae8-01d97e219ba7" returned: 0 in 0.868s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Lock "cinder-quobyte-cb2fd846-0efb-4595-8ae8-01d97e219ba7" released by "delete_volume" :: held 2.197s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Created reservations ['d0db92bd-9236-4d26-b6fd-c642297d3a6e', '87e70509-43e5-47dc-a389-eb5351b0ac22', '26e7b6cf-773c-4b5a-9b72-868f01f106be', 'b9bb357f-d91a-438f-bc99-60c3f58d219c'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:48 devstack sudo[113613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:34:48 devstack sudo[113613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (6bfd1155-1237-40d1-b3ea-7fb4fd461c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cff1af8-b63d-4f73-afd2-82a3717b1f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cff1af8-b63d-4f73-afd2-82a3717b1f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1792818147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274d42e5-ab1f-4e9b-a102-11d843bab9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:49Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f58e903-cc98-40e3-bd9d-bb26236afb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f58e903-cc98-40e3-bd9d-bb26236afb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf29f9b-d1d8-4c76-aa6d-3f0955510713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf29f9b-d1d8-4c76-aa6d-3f0955510713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274d42e5-ab1f-4e9b-a102-11d843bab9b5', 'volume_name': 'volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4f30ac-1bb4-4812-ad75-f181625c93bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4f30ac-1bb4-4812-ad75-f181625c93bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c21d2f1-0bc7-4254-814b-89797592970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:48 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Volume 274d42e5-ab1f-4e9b-a102-11d843bab9b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5', 'volume_size': 1} Jun 23 20:34:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:49 devstack sudo[113610]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476" returned: 0 in 1.212s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] <== create_volume: return (2953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.959s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1792818147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274d42e5-ab1f-4e9b-a102-11d843bab9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:49Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Creating volume 274d42e5-ab1f-4e9b-a102-11d843bab9b5 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:49 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:49 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 1073741824 Jun 23 20:34:49 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd680f8c-9752-4e41-8220-b09a0f000a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e15313-3475-4f55-8faa-bce1b1ae9476', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7119cf-a102-4c2c-a437-e767f96a9a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:49 devstack sudo[113613]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.878s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (f55740a1-df53-48b7-b805-47584282aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741b1280-14e9-4381-9acc-159164156390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:49 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Volume volume-37e15313-3475-4f55-8faa-bce1b1ae9476 (37e15313-3475-4f55-8faa-bce1b1ae9476): created successfully Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7119cf-a102-4c2c-a437-e767f96a9a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Flow 'volume_create_manager' (58bdb470-fc65-4961-b7f8-caab23fcae59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Deleted volume successfully. Jun 23 20:34:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-dec50acd-5293-4499-96ff-7e9b4a4f899a tempest-CinderUnicodeTest-815795262 None] Created volume successfully. Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-27e20768-33d4-4202-848c-436bf6ddd4dc tempest-VolumeDependencyTests-368025864 None] Lock "cinder-cb2fd846-0efb-4595-8ae8-01d97e219ba7-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741b1280-14e9-4381-9acc-159164156390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523211349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efed7851-2d6d-46fd-a809-a0683dc8d6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:49Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f06c90-9fb7-4c97-b866-526b75cf56a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f06c90-9fb7-4c97-b866-526b75cf56a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc269876-f6d0-4a7e-b9d4-d9ca2b9f6fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc269876-f6d0-4a7e-b9d4-d9ca2b9f6fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efed7851-2d6d-46fd-a809-a0683dc8d6e6', 'volume_name': 'volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3db6233-3a0b-4507-933e-5e885dbfd469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3db6233-3a0b-4507-933e-5e885dbfd469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dfd65d-0043-42a7-9b4f-fa014cd14555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:49 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Volume efed7851-2d6d-46fd-a809-a0683dc8d6e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6', 'volume_size': 1} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (9aecbec6-6259-468e-addb-52895b12e06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:49 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5817921-76be-4438-917b-a08f775e4865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5817921-76be-4438-917b-a08f775e4865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075935347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8247feb-813d-4788-ae8a-285840381b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:50Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82212fed-5936-462f-9cfb-2a550472f6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82212fed-5936-462f-9cfb-2a550472f6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c4fc59-df93-4ede-8586-efcdd75791cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c4fc59-df93-4ede-8586-efcdd75791cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8247feb-813d-4788-ae8a-285840381b4a', 'volume_name': 'volume-e8247feb-813d-4788-ae8a-285840381b4a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47c3728-21a6-4ad3-8029-fceec3035d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47c3728-21a6-4ad3-8029-fceec3035d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de59a65-96f4-4e3f-b413-34442d888500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:50 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Volume e8247feb-813d-4788-ae8a-285840381b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8247feb-813d-4788-ae8a-285840381b4a', 'volume_size': 1} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:50 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 1073741824" returned: 0 in 1.621s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (17c81867-d430-4d38-a938-43f22a32e7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:50 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea75ff6-34ab-4795-a8b2-2c024fc3a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea75ff6-34ab-4795-a8b2-2c024fc3a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849557764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ebb2e9-2531-4157-9963-08fcacb8a673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:51Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab71669-a546-4b4f-8b5b-7ffe4a5460f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab71669-a546-4b4f-8b5b-7ffe4a5460f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0228a88-d4cb-45e9-b590-2dfe5b5d595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0228a88-d4cb-45e9-b590-2dfe5b5d595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ebb2e9-2531-4157-9963-08fcacb8a673', 'volume_name': 'volume-16ebb2e9-2531-4157-9963-08fcacb8a673', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf42006-541c-4238-8b88-08487b138340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf42006-541c-4238-8b88-08487b138340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42f0657-e9a9-4092-9f1a-d2cb77dce533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Volume 16ebb2e9-2531-4157-9963-08fcacb8a673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ebb2e9-2531-4157-9963-08fcacb8a673', 'volume_size': 1} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:51 devstack sudo[113625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 Jun 23 20:34:51 devstack sudo[113625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (abfe3db8-f4c1-4d0f-b0e0-c23bb6ad0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407a6db1-2682-4211-a1e9-a91b5e0a1cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407a6db1-2682-4211-a1e9-a91b5e0a1cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1026361488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21911963-a566-4138-9b1a-5961ad8e922a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:51Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8d44ae-c194-4d93-9d98-039f68511422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8d44ae-c194-4d93-9d98-039f68511422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b72334-672f-4a11-aa49-799a1c611cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b72334-672f-4a11-aa49-799a1c611cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21911963-a566-4138-9b1a-5961ad8e922a', 'volume_name': 'volume-21911963-a566-4138-9b1a-5961ad8e922a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e794134-b813-4f06-9992-b751acf59dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e794134-b813-4f06-9992-b751acf59dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a547f03-44aa-48bc-8a42-afc6200216ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Volume 21911963-a566-4138-9b1a-5961ad8e922a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21911963-a566-4138-9b1a-5961ad8e922a', 'volume_size': 1} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:51 devstack sudo[113625]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5" returned: 0 in 0.795s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] <== create_volume: return (2710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.715s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.417s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523211349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efed7851-2d6d-46fd-a809-a0683dc8d6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:49Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Creating volume efed7851-2d6d-46fd-a809-a0683dc8d6e6 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:51 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:51 devstack sudo[113631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 1073741824 Jun 23 20:34:51 devstack sudo[113631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c21d2f1-0bc7-4254-814b-89797592970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3273f1b8-14f8-474a-b01a-77c26a45b429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:51 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Volume volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 (274d42e5-ab1f-4e9b-a102-11d843bab9b5): created successfully Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3273f1b8-14f8-474a-b01a-77c26a45b429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:51 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (6bfd1155-1237-40d1-b3ea-7fb4fd461c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:51 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-eaaabbf8-dd6b-43b4-8085-715dc9a6995c tempest-CreateVolumesFromImageTest-1940416655 None] Created volume successfully. Jun 23 20:34:52 devstack sudo[113631]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 1073741824" returned: 0 in 0.942s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:52 devstack sudo[113637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 Jun 23 20:34:52 devstack sudo[113637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:53 devstack sudo[113637]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6" returned: 0 in 0.711s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.510s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075935347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8247feb-813d-4788-ae8a-285840381b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:50Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Creating volume e8247feb-813d-4788-ae8a-285840381b4a {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:53 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:53 devstack sudo[113640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a 1073741824 Jun 23 20:34:53 devstack sudo[113640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dfd65d-0043-42a7-9b4f-fa014cd14555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9905b499-0c29-4259-9121-6c92cbb51984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:53 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Volume volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 (efed7851-2d6d-46fd-a809-a0683dc8d6e6): created successfully Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9905b499-0c29-4259-9121-6c92cbb51984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:53 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (f55740a1-df53-48b7-b805-47584282aec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:53 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-3b1f2417-7608-4d8d-a77b-1f62dfbb6af9 tempest-CreateVolumesFromImageTest-1940416655 None] Created volume successfully. Jun 23 20:34:54 devstack sudo[113640]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a 1073741824" returned: 0 in 0.919s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:54 devstack sudo[113647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a Jun 23 20:34:54 devstack sudo[113647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:55 devstack sudo[113647]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a" returned: 0 in 0.771s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.269s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849557764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ebb2e9-2531-4157-9963-08fcacb8a673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:51Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Creating volume 16ebb2e9-2531-4157-9963-08fcacb8a673 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:34:55 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de59a65-96f4-4e3f-b413-34442d888500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8247feb-813d-4788-ae8a-285840381b4a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b44b9a-ad9c-4818-919e-02cd8ad943d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:55 devstack sudo[113650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 1073741824 Jun 23 20:34:55 devstack sudo[113650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:55 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Volume volume-e8247feb-813d-4788-ae8a-285840381b4a (e8247feb-813d-4788-ae8a-285840381b4a): created successfully Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b44b9a-ad9c-4818-919e-02cd8ad943d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:55 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (9aecbec6-6259-468e-addb-52895b12e06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:55 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-b4bda9c0-c400-471e-9d39-ddfba6ccbe5b tempest-CreateVolumesFromImageTest-1940416655 None] Created volume successfully. Jun 23 20:34:56 devstack sudo[113650]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 1073741824" returned: 0 in 1.042s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:56 devstack sudo[113656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 Jun 23 20:34:56 devstack sudo[113656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:57 devstack sudo[113656]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673" returned: 0 in 0.764s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.147s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42f0657-e9a9-4092-9f1a-d2cb77dce533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ebb2e9-2531-4157-9963-08fcacb8a673', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb591717-2d4f-42d8-915c-ebb7120fa903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Creating offline snapshot 5646a01e-f0fc-49dd-9c44-d5492bc31699 of volume 37e15313-3475-4f55-8faa-bce1b1ae9476 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:34:57 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Volume volume-16ebb2e9-2531-4157-9963-08fcacb8a673 (16ebb2e9-2531-4157-9963-08fcacb8a673): created successfully Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb591717-2d4f-42d8-915c-ebb7120fa903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (17c81867-d430-4d38-a938-43f22a32e7ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8406c905-117c-4a9f-a761-51faab9b569b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:34:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:57 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7078ba1d-4abe-4ed8-a608-804111fc6f56 tempest-CreateVolumesFromImageTest-1940416655 None] Created volume successfully. Jun 23 20:34:57 devstack sudo[113659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 Jun 23 20:34:57 devstack sudo[113659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:58 devstack sudo[113659]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476" returned: 0 in 0.898s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:58 devstack sudo[113664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 1G Jun 23 20:34:58 devstack sudo[113664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 1G" returned: 0 in 0.942s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37e15313-3475-4f55-8faa-bce1b1ae9476 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:59 devstack sudo[113664]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:59 devstack sudo[113669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37e15313-3475-4f55-8faa-bce1b1ae9476 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 Jun 23 20:34:59 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:34:59 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root Jun 23 20:34:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37e15313-3475-4f55-8faa-bce1b1ae9476 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699" returned: 0 in 0.727s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:34:59 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 is being set with open permissions: ugo+rw Jun 23 20:34:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:34:59 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 Jun 23 20:34:59 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:00 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699" returned: 0 in 0.671s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:00 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.info Jun 23 20:35:00 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:01 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.info" returned: 0 in 0.699s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:01 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.info is being set with open permissions: ugo+rw Jun 23 20:35:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:01 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.info Jun 23 20:35:01 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:02 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.info" returned: 0 in 0.751s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.834s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.664s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1026361488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21911963-a566-4138-9b1a-5961ad8e922a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85d08577b148eb9285bc813cb8ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:34:51Z,use_quota=True,user_id='bbf97a4a0ff648589cb4dfc88ab17dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Creating volume 21911963-a566-4138-9b1a-5961ad8e922a {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:02 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:35:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:02 devstack sudo[113686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a 1073741824 Jun 23 20:35:02 devstack sudo[113686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-d03230d8-9e7b-476b-b87b-59f1ce41717c tempest-CinderUnicodeTest-815795262 None] Create snapshot completed successfully Jun 23 20:35:03 devstack sudo[113686]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a 1073741824" returned: 0 in 0.955s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=149,cinder:SELECT=99,cinder:INSERT=42,cinder:DELETE=20 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=117,cinder:UPDATE=130,cinder:DELETE=8,cinder:INSERT=38 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:03 devstack sudo[113692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a Jun 23 20:35:03 devstack sudo[113692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Acquiring lock "cinder-5646a01e-f0fc-49dd-9c44-d5492bc31699-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-5646a01e-f0fc-49dd-9c44-d5492bc31699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Acquiring lock "cinder-quobyte-37e15313-3475-4f55-8faa-bce1b1ae9476" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-quobyte-37e15313-3475-4f55-8faa-bce1b1ae9476" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Acquiring lock "cinder-quobyte-5646a01e-f0fc-49dd-9c44-d5492bc31699" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-quobyte-5646a01e-f0fc-49dd-9c44-d5492bc31699" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Deleting offline snapshot 5646a01e-f0fc-49dd-9c44-d5492bc31699 of volume 37e15313-3475-4f55-8faa-bce1b1ae9476 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] snapshot_file for this snap is: volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bd72a4-c52a-41b3-902b-40283433e1e9]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:03 devstack sudo[113695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 Jun 23 20:35:03 devstack sudo[113695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:03 devstack sudo[113692]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a" returned: 0 in 0.789s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a547f03-44aa-48bc-8a42-afc6200216ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21911963-a566-4138-9b1a-5961ad8e922a', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67db7aa-8024-4f20-9bed-7512727932b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:03 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Volume volume-21911963-a566-4138-9b1a-5961ad8e922a (21911963-a566-4138-9b1a-5961ad8e922a): created successfully Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67db7aa-8024-4f20-9bed-7512727932b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:03 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Flow 'volume_create_manager' (abfe3db8-f4c1-4d0f-b0e0-c23bb6ad0075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:03 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-5953c0fb-2481-4484-8ca9-d6c6d03c56d5 tempest-CreateVolumesFromImageTest-1940416655 None] Created volume successfully. Jun 23 20:35:04 devstack sudo[113695]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699" returned: 0 in 0.842s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37e15313-3475-4f55-8faa-bce1b1ae9476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb2ad58-a125-4953-9dbb-2b37cac668da]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-21911963-a566-4138-9b1a-5961ad8e922a-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-21911963-a566-4138-9b1a-5961ad8e922a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:04 devstack sudo[113701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 Jun 23 20:35:04 devstack sudo[113701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-quobyte-21911963-a566-4138-9b1a-5961ad8e922a" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-21911963-a566-4138-9b1a-5961ad8e922a" acquired by "delete_volume" :: waited 0.026s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb23c969-eb3e-4e55-9c69-67f3c1be2948]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:04 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:04 devstack sudo[113704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a Jun 23 20:35:04 devstack sudo[113704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:05 devstack sudo[113701]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476" returned: 0 in 0.888s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:05 devstack sudo[113709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 Jun 23 20:35:05 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:05 devstack sudo[113704]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a" returned: 0 in 1.037s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:05 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:05 devstack sudo[113714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a Jun 23 20:35:05 devstack sudo[113714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:06 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699" returned: 0 in 0.996s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:06 devstack sudo[113719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699 Jun 23 20:35:06 devstack sudo[113719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:06 devstack sudo[113714]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-21911963-a566-4138-9b1a-5961ad8e922a" returned: 0 in 0.823s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-21911963-a566-4138-9b1a-5961ad8e922a" released by "delete_volume" :: held 1.918s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Created reservations ['3d558315-e55d-4a82-a223-2d7649669fee', 'dc840fa6-200f-4a07-a5f5-9f5f59bf5a18', '855a6118-eaac-43ec-9748-247de6cb0fb9', '6dd66fce-5bcb-4d2d-a2e9-148ab8031658'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:06 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:06 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-16ebb2e9-2531-4157-9963-08fcacb8a673-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-16ebb2e9-2531-4157-9963-08fcacb8a673-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-quobyte-16ebb2e9-2531-4157-9963-08fcacb8a673" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-16ebb2e9-2531-4157-9963-08fcacb8a673" acquired by "delete_volume" :: waited 0.042s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bf2376-278c-446b-adfa-d5873a710d47]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:06 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:07 devstack sudo[113724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 Jun 23 20:35:07 devstack sudo[113724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:07 devstack sudo[113719]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:07 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476.5646a01e-f0fc-49dd-9c44-d5492bc31699" returned: 0 in 1.127s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-quobyte-5646a01e-f0fc-49dd-9c44-d5492bc31699" released by "_delete_snapshot" :: held 4.028s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-quobyte-37e15313-3475-4f55-8faa-bce1b1ae9476" released by "delete_snapshot" :: held 4.060s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:07 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Created reservations ['73527315-1ee7-4692-807e-f86c773087a5', '0b4b427a-909f-4c1d-9df1-33eaa6ec9cc8', '827134d7-e5b9-4c75-a010-3592fc3fb59c', '1a5b2263-59b7-4088-a4ac-d414a41dff39'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:07 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Delete snapshot completed successfully. Jun 23 20:35:07 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9c2a9c15-017b-42f7-b350-89ff315443b5 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-5646a01e-f0fc-49dd-9c44-d5492bc31699-delete_snapshot" released by "delete_snapshot" :: held 4.402s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:07 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 1.350s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:08 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Deleted volume successfully. Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-f6086068-a84f-45b2-a7bd-472a0888fae2 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-21911963-a566-4138-9b1a-5961ad8e922a-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:08 devstack sudo[113724]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673" returned: 0 in 1.265s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:08 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673 Jun 23 20:35:08 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Acquiring lock "cinder-37e15313-3475-4f55-8faa-bce1b1ae9476-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-37e15313-3475-4f55-8faa-bce1b1ae9476-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Acquiring lock "cinder-quobyte-37e15313-3475-4f55-8faa-bce1b1ae9476" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-quobyte-37e15313-3475-4f55-8faa-bce1b1ae9476" acquired by "delete_volume" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d0cb0c-798c-4dce-8626-2a046495094b]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:08 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:09 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 Jun 23 20:35:09 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:09 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-16ebb2e9-2531-4157-9963-08fcacb8a673" returned: 0 in 0.784s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-16ebb2e9-2531-4157-9963-08fcacb8a673" released by "delete_volume" :: held 2.137s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Created reservations ['a91ae0b7-40e7-4018-9eed-3ad37a275430', '342dbff8-3e1d-461a-9e71-63fd1cd665c8', 'f33f335d-1990-45d2-92ca-2a220a5a419c', '1cd6426e-8b94-46be-b10b-3f9d0949607e'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:09 devstack sudo[113736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:09 devstack sudo[113736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:09 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476" returned: 0 in 0.895s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:09 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:09 devstack sudo[113741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476 Jun 23 20:35:09 devstack sudo[113741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:10 devstack sudo[113736]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.775s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:10 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Deleted volume successfully. Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-255590ef-ed27-47fb-bf16-51729db79183 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-16ebb2e9-2531-4157-9963-08fcacb8a673-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-e8247feb-813d-4788-ae8a-285840381b4a-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-e8247feb-813d-4788-ae8a-285840381b4a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-quobyte-e8247feb-813d-4788-ae8a-285840381b4a" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-e8247feb-813d-4788-ae8a-285840381b4a" acquired by "delete_volume" :: waited 0.018s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2668b68d-0ede-4742-87c0-8171a2d942b6]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:10 devstack sudo[113744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a Jun 23 20:35:10 devstack sudo[113744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:10 devstack sudo[113741]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-37e15313-3475-4f55-8faa-bce1b1ae9476" returned: 0 in 0.858s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-quobyte-37e15313-3475-4f55-8faa-bce1b1ae9476" released by "delete_volume" :: held 1.871s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Created reservations ['c1451b2b-0d10-4664-89dc-e5d1170711ee', '19534f06-39f7-4a7c-ac96-f0e46c8c7239', '2ece2e72-7001-4f66-8391-88203c53804a', '6f66ead0-f859-490a-b185-564132a4f2b0'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:10 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:10 devstack sudo[113747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:10 devstack sudo[113747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Acquiring lock "cinder-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Lock "cinder-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Acquiring lock "cinder-quobyte-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Lock "cinder-quobyte-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[958e9180-a79a-4dbb-8352-68950aa4f683]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:11 devstack sudo[113744]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a" returned: 0 in 1.039s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:11 devstack sudo[113753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a Jun 23 20:35:11 devstack sudo[113753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:11 devstack sudo[113752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 Jun 23 20:35:11 devstack sudo[113752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:11 devstack sudo[113747]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.800s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:11 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Deleted volume successfully. Jun 23 20:35:11 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c5b4461d-7634-41ee-9bbe-d4135e183d07 tempest-CinderUnicodeTest-815795262 None] Lock "cinder-37e15313-3475-4f55-8faa-bce1b1ae9476-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:12 devstack sudo[113753]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-e8247feb-813d-4788-ae8a-285840381b4a" returned: 0 in 0.800s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-e8247feb-813d-4788-ae8a-285840381b4a" released by "delete_volume" :: held 1.889s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:12 devstack sudo[113752]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870" returned: 0 in 0.962s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:12 devstack sudo[113761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870 Jun 23 20:35:12 devstack sudo[113761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Created reservations ['bf8bc9e7-fccc-43f5-bdb8-b8d61330b941', 'f3403a90-1eb7-4556-ad64-dc58234c9164', '90a1126e-75e1-4db0-b697-0d203eddb485', '505b2a1c-e079-43ed-99a6-19fcc8879eaf'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Flow 'volume_create_manager' (3d9ffd1d-86f7-4b78-8cf4-b013fb2295aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8899f383-0dd6-4d60-9348-6169a3e5597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8899f383-0dd6-4d60-9348-6169a3e5597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2001015376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9b97670b8a488f946b4b63a167b98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:12Z,use_quota=True,user_id='24c356b0eb064b44beaec7e65065f3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f88bf7-6a6a-4d84-8b53-94c7de2f707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f88bf7-6a6a-4d84-8b53-94c7de2f707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e48c10-26d4-4d12-9797-5a0745b0af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e48c10-26d4-4d12-9797-5a0745b0af4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd', 'volume_name': 'volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbdbc08-84c2-4ca3-a9d2-f15f02006d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbdbc08-84c2-4ca3-a9d2-f15f02006d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baed7870-bd20-4239-9a6f-7428a995aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:12 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Volume 1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd', 'volume_size': 1} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2001015376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9b97670b8a488f946b4b63a167b98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:12Z,use_quota=True,user_id='24c356b0eb064b44beaec7e65065f3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Creating volume 1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:12 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:12 devstack sudo[113763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd 1073741824 Jun 23 20:35:12 devstack sudo[113763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:12 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:12 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-efed7851-2d6d-46fd-a809-a0683dc8d6e6-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-efed7851-2d6d-46fd-a809-a0683dc8d6e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-quobyte-efed7851-2d6d-46fd-a809-a0683dc8d6e6" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-efed7851-2d6d-46fd-a809-a0683dc8d6e6" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b202ad-7221-4752-b812-276880694d4c]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:12 devstack sudo[113767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 Jun 23 20:35:12 devstack sudo[113767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:12 devstack sudo[113761]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870" returned: 0 in 0.770s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:12 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Lock "cinder-quobyte-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870" released by "delete_volume" :: held 1.781s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Created reservations ['9e51d6cd-3607-438b-863a-0a3a41c7498a', 'b2968573-86fc-45b3-8c4c-1b9dd9a96209', '59a9a3f9-2340-4a87-aa8f-d1e478423129', 'a1eb22d8-16b5-4953-8cb3-9696a18491d2'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:13 devstack sudo[113773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:13 devstack sudo[113773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:13 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.831s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:13 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Deleted volume successfully. Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-69a36bfc-7aac-4c39-8b55-1a39875e4dda tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-e8247feb-813d-4788-ae8a-285840381b4a-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:13 devstack sudo[113763]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd 1073741824" returned: 0 in 1.026s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:13 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd Jun 23 20:35:13 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:13 devstack sudo[113767]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6" returned: 0 in 0.932s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:13 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6 Jun 23 20:35:13 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:13 devstack sudo[113773]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.807s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:13 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Deleted volume successfully. Jun 23 20:35:13 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-9082bd5a-4b00-47f5-90d2-42467208ec4c tempest-CinderUnicodeTest-815795262 None] Lock "cinder-5576f9b6-9d29-4b89-9e8f-ad5a5e7ea870-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:14 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" returned: 0 in 0.876s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baed7870-bd20-4239-9a6f-7428a995aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c5f09d-15fc-4c59-bed9-468600b61f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:14 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Volume volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd (1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd): created successfully Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c5f09d-15fc-4c59-bed9-468600b61f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Flow 'volume_create_manager' (3d9ffd1d-86f7-4b78-8cf4-b013fb2295aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:14 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4db6e302-6dc5-436c-85cc-60d5753f461b tempest-SnapshotDependencyTests-179661627 None] Created volume successfully. Jun 23 20:35:14 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-efed7851-2d6d-46fd-a809-a0683dc8d6e6" returned: 0 in 0.795s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-efed7851-2d6d-46fd-a809-a0683dc8d6e6" released by "delete_volume" :: held 1.776s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Created reservations ['fd84ea41-ec3a-4749-8e0a-492d3e041752', '76bd26eb-3c62-43de-b6a4-7c3704603add', '0d5c3e22-a6fe-4bb6-bb50-1cbe3fd128e8', 'bf2e2bc3-2bb9-42b1-aff8-be0342312e02'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:14 devstack sudo[113789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:14 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-274d42e5-ab1f-4e9b-a102-11d843bab9b5-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-274d42e5-ab1f-4e9b-a102-11d843bab9b5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "cinder-quobyte-274d42e5-ab1f-4e9b-a102-11d843bab9b5" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-274d42e5-ab1f-4e9b-a102-11d843bab9b5" acquired by "delete_volume" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[008460d1-60e0-4a46-a1ac-108a382e92df]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:14 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:15 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 Jun 23 20:35:15 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:15 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.753s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:15 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Deleted volume successfully. Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-539c6595-adaa-4375-97a3-715c7e03cf2d tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-efed7851-2d6d-46fd-a809-a0683dc8d6e6-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:15 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5" returned: 0 in 0.850s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Creating offline snapshot f2171a59-d933-4c13-9a09-94aaea78acf0 of volume 1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:35:15 devstack sudo[113797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5 Jun 23 20:35:15 devstack sudo[113797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bdd080-6c66-4447-b2f4-aa0fdf42493d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:15 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:15 devstack sudo[113799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd Jun 23 20:35:15 devstack sudo[113799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:16 devstack sudo[113797]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-274d42e5-ab1f-4e9b-a102-11d843bab9b5" returned: 0 in 0.738s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-quobyte-274d42e5-ab1f-4e9b-a102-11d843bab9b5" released by "delete_volume" :: held 1.642s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Created reservations ['af1857aa-14a0-47da-b832-ea648b0cedd0', '605ebec4-8c46-4f6f-89cf-b0ea9a4e4490', '51551444-1c7c-4d93-b6c1-7671c7912476', '721b8fe5-e526-4a65-ad02-8d00a2ff33a1'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:16 devstack sudo[113799]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" returned: 0 in 0.866s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:16 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 1G Jun 23 20:35:16 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:16 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:16 devstack sudo[113808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:16 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:17 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.683s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:17 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:17 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Deleted volume successfully. Jun 23 20:35:17 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-709270ae-70d2-4e40-baa6-cf63ea9f2d50 tempest-CreateVolumesFromImageTest-1940416655 None] Lock "cinder-274d42e5-ab1f-4e9b-a102-11d843bab9b5-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:17 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 1G" returned: 0 in 0.862s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:17 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:17 devstack sudo[113815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 Jun 23 20:35:17 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:18 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0" returned: 0 in 0.754s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:18 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 is being set with open permissions: ugo+rw Jun 23 20:35:18 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:18 devstack sudo[113820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 Jun 23 20:35:18 devstack sudo[113820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:19 devstack sudo[113820]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0" returned: 0 in 0.722s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:19 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.info Jun 23 20:35:19 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:19 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.info" returned: 0 in 0.727s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:19 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.info is being set with open permissions: ugo+rw Jun 23 20:35:19 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:19 devstack sudo[113827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.info Jun 23 20:35:19 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (ff03ddcb-d19d-4782-82e6-b4593cc5e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa465ba0-d3e5-49e8-b94c-95fdcc13e9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa465ba0-d3e5-49e8-b94c-95fdcc13e9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-481003543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af04a02-a3cc-4896-b2ad-b3462e5375b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:20Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e757ddfe-8637-4fe1-86d2-403d02619e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e757ddfe-8637-4fe1-86d2-403d02619e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bdb85e-1772-4d7f-b5d4-9be786a1f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bdb85e-1772-4d7f-b5d4-9be786a1f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af04a02-a3cc-4896-b2ad-b3462e5375b2', 'volume_name': 'volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb59b708-9ccb-4fca-bdd7-05661fdf904d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb59b708-9ccb-4fca-bdd7-05661fdf904d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa97650-7804-4000-85ae-a3282e9993d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:20 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume 5af04a02-a3cc-4896-b2ad-b3462e5375b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2', 'volume_size': 1} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:20 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.info" returned: 0 in 0.661s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.709s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.367s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-481003543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af04a02-a3cc-4896-b2ad-b3462e5375b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:20Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Creating volume 5af04a02-a3cc-4896-b2ad-b3462e5375b2 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:20 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:35:20 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:20 devstack sudo[113830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 1073741824 Jun 23 20:35:20 devstack sudo[113830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:20 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-87f015c6-63e1-4dfc-b840-1f775d33d2ab tempest-SnapshotDependencyTests-179661627 None] Create snapshot completed successfully Jun 23 20:35:21 devstack sudo[113830]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 1073741824" returned: 0 in 0.891s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:21 devstack sudo[113836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 Jun 23 20:35:21 devstack sudo[113836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Flow 'volume_create_manager' (88dab48c-b91d-4be7-944e-111f4e69910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a716525a-097c-4813-9046-e32ab886c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a716525a-097c-4813-9046-e32ab886c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09477479-2f4f-483d-a3a1-9f42714cf741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9b97670b8a488f946b4b63a167b98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2171a59-d933-4c13-9a09-94aaea78acf0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:22Z,use_quota=True,user_id='24c356b0eb064b44beaec7e65065f3bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e6098b-58b5-4e8c-9047-ec42d2785864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e6098b-58b5-4e8c-9047-ec42d2785864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d79a6a4-f926-4c36-b482-ed0cecfcb429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d79a6a4-f926-4c36-b482-ed0cecfcb429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09477479-2f4f-483d-a3a1-9f42714cf741', 'volume_name': 'volume-09477479-2f4f-483d-a3a1-9f42714cf741', 'volume_size': 1, 'snapshot_id': 'f2171a59-d933-4c13-9a09-94aaea78acf0'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60417f59-6a47-45c2-8782-af7ef544951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60417f59-6a47-45c2-8782-af7ef544951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8920c5-ddf2-4981-94b7-21be2324d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:21 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Volume 09477479-2f4f-483d-a3a1-9f42714cf741: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09477479-2f4f-483d-a3a1-9f42714cf741', 'volume_size': 1, 'snapshot_id': 'f2171a59-d933-4c13-9a09-94aaea78acf0'} Jun 23 20:35:21 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:22 devstack sudo[113836]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2" returned: 0 in 0.715s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.404s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-quobyte-f2171a59-d933-4c13-9a09-94aaea78acf0-09477479-2f4f-483d-a3a1-9f42714cf741" by "_create_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-f2171a59-d933-4c13-9a09-94aaea78acf0-09477479-2f4f-483d-a3a1-9f42714cf741" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Creating volume 09477479-2f4f-483d-a3a1-9f42714cf741 from snapshot f2171a59-d933-4c13-9a09-94aaea78acf0 {{(pid=93739) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-quobyte-09477479-2f4f-483d-a3a1-9f42714cf741" by "_copy_volume_from_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa97650-7804-4000-85ae-a3282e9993d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea924d1-ac1c-4473-bc60-df33ba6ba156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-09477479-2f4f-483d-a3a1-9f42714cf741" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] snapshot: f2171a59-d933-4c13-9a09-94aaea78acf0, volume: 09477479-2f4f-483d-a3a1-9f42714cf741, {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 20:35:22 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 (5af04a02-a3cc-4896-b2ad-b3462e5375b2): created successfully Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea924d1-ac1c-4473-bc60-df33ba6ba156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (ff03ddcb-d19d-4782-82e6-b4593cc5e03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:22 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-e82cde6f-dd5a-4021-84d9-aa8747783195 tempest-CreateVolumesFromSnapshotTest-776528514 None] Created volume successfully. Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d8bb56-cab7-4a9f-8721-e8f7833da62d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:22 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:22 devstack sudo[113841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 Jun 23 20:35:22 devstack sudo[113841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:23 devstack sudo[113841]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0" returned: 0 in 0.820s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:35:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 20:35:23 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Creating direct copy from snapshot {{(pid=93739) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 20:35:23 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfcb5bc-4646-4a59-8c32-0bfb69d11abf]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:23 devstack sudo[113846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd Jun 23 20:35:23 devstack sudo[113846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:23 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:24 devstack sudo[113846]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" returned: 0 in 0.866s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:24 devstack cinder-volume[93739]: DEBUG cinder.utils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Path /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 not found in is_blk_device check {{(pid=93739) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 20:35:24 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:24 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 Jun 23 20:35:24 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:28 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741" returned: 0 in 4.783s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:28 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c531d62-41fa-4a81-9347-d818c92b4fef]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:28 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:28 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd Jun 23 20:35:28 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:29 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" returned: 0 in 0.899s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:29 devstack cinder-volume[93739]: DEBUG cinder.image.image_utils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Image conversion details: src /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 {{(pid=93739) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 20:35:29 devstack cinder-volume[93739]: INFO cinder.image.image_utils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Converted 1024.00 MB image at 213.98 MB/s Jun 23 20:35:29 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 is being set with open permissions: ugo+rw Jun 23 20:35:29 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:29 devstack sudo[113871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 Jun 23 20:35:29 devstack sudo[113871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:30 devstack sudo[113871]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741" returned: 0 in 0.632s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-09477479-2f4f-483d-a3a1-9f42714cf741" released by "_copy_volume_from_snapshot" :: held 8.104s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-f2171a59-d933-4c13-9a09-94aaea78acf0-09477479-2f4f-483d-a3a1-9f42714cf741" released by "_create_volume_from_snapshot" :: held 8.147s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.165s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.645s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Creating offline snapshot 23c13b1d-0cfc-47cf-9a81-8cfeb58359db of volume 5af04a02-a3cc-4896-b2ad-b3462e5375b2 {{(pid=93739) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[20512ca3-8d24-4b43-bc57-96890bd8d243]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8920c5-ddf2-4981-94b7-21be2324d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09477479-2f4f-483d-a3a1-9f42714cf741', 'volume_size': 1, 'snapshot_id': 'f2171a59-d933-4c13-9a09-94aaea78acf0'}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bc4bdb-f7a1-4a99-9b8c-1ef1347cb227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:30 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Volume volume-09477479-2f4f-483d-a3a1-9f42714cf741 (09477479-2f4f-483d-a3a1-9f42714cf741): created successfully Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bc4bdb-f7a1-4a99-9b8c-1ef1347cb227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:30 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Flow 'volume_create_manager' (88dab48c-b91d-4be7-944e-111f4e69910a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:30 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-bec3e02b-4e16-40f1-8b51-d13bf959a177 tempest-SnapshotDependencyTests-179661627 None] Created volume successfully. Jun 23 20:35:30 devstack sudo[113874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 Jun 23 20:35:30 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:31 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2" returned: 0 in 0.739s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db 1G {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:31 devstack sudo[113879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db 1G Jun 23 20:35:31 devstack sudo[113879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-f2171a59-d933-4c13-9a09-94aaea78acf0-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-f2171a59-d933-4c13-9a09-94aaea78acf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-quobyte-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-quobyte-f2171a59-d933-4c13-9a09-94aaea78acf0" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-f2171a59-d933-4c13-9a09-94aaea78acf0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Deleting offline snapshot f2171a59-d933-4c13-9a09-94aaea78acf0 of volume 1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] snapshot_file for this snap is: volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3521183f-532e-4e6f-9eee-e9a7cb640c86]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:31 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 Jun 23 20:35:31 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:31 devstack sudo[113879]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db 1G" returned: 0 in 0.785s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:31 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:31 devstack sudo[113886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db Jun 23 20:35:31 devstack sudo[113886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:32 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0" returned: 0 in 0.763s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:32 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:35:32 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c4b8e-9ed9-466e-aadb-2f1898d457e1]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:32 devstack sudo[113891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd Jun 23 20:35:32 devstack sudo[113891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:32 devstack sudo[113886]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 -F qcow2 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db" returned: 0 in 0.671s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:32 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db is being set with open permissions: ugo+rw Jun 23 20:35:32 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:32 devstack sudo[113896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db Jun 23 20:35:32 devstack sudo[113896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:33 devstack sudo[113891]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" returned: 0 in 0.813s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:33 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 Jun 23 20:35:33 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:33 devstack sudo[113896]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db" returned: 0 in 0.669s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:33 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.info Jun 23 20:35:33 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:33 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0" returned: 0 in 0.731s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:33 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:33 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0 Jun 23 20:35:33 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:33 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.info" returned: 0 in 0.691s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:34 devstack cinder-volume[93739]: WARNING cinder.volume.drivers.remotefs [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.info is being set with open permissions: ugo+rw Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.info {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:34 devstack sudo[113948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.info Jun 23 20:35:34 devstack sudo[113948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:34 devstack sudo[113948]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.info" returned: 0 in 0.631s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.275s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:34 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd.f2171a59-d933-4c13-9a09-94aaea78acf0" returned: 0 in 0.685s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-4af3e96a-28ed-4ee3-8801-3af80e3c7d72 tempest-CreateVolumesFromSnapshotTest-776528514 None] Create snapshot completed successfully Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-f2171a59-d933-4c13-9a09-94aaea78acf0" released by "_delete_snapshot" :: held 3.098s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" released by "delete_snapshot" :: held 3.120s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Created reservations ['8f624a53-ef70-4f98-8416-f46467e78ba9', '03f9a69e-d652-4fc2-aa19-b532248ee578', '6a456b37-51cc-4a22-a64a-faec7641adbc', '53ef51b4-584f-4440-a445-4b1b4124cdf9'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:34 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Delete snapshot completed successfully. Jun 23 20:35:34 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-cc46173c-671e-4ba9-8df1-37c5071ed7ec tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-f2171a59-d933-4c13-9a09-94aaea78acf0-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (6c638b18-8537-4404-adbe-18931d2f4a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5058cc-1deb-4984-bfa5-61dcc13c8316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5058cc-1deb-4984-bfa5-61dcc13c8316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1344827465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ca870e-dc82-438f-bf13-7dd058c7c8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:36Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b0fd69-9aaf-4ed2-8802-9a4096e2bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b0fd69-9aaf-4ed2-8802-9a4096e2bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be4b3fc-ed80-4f2b-a8ff-3c4463ab5f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be4b3fc-ed80-4f2b-a8ff-3c4463ab5f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ca870e-dc82-438f-bf13-7dd058c7c8a8', 'volume_name': 'volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8296d1-af95-41db-be2f-ea68394efeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8296d1-af95-41db-be2f-ea68394efeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89181e06-98d3-40ba-ad51-4ecd1353df84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:35 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume a7ca870e-dc82-438f-bf13-7dd058c7c8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8', 'volume_size': 1} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1344827465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ca870e-dc82-438f-bf13-7dd058c7c8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:36Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Creating volume a7ca870e-dc82-438f-bf13-7dd058c7c8a8 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:35 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:35 devstack sudo[113953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 1073741824 Jun 23 20:35:35 devstack sudo[113953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-quobyte-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" acquired by "delete_volume" :: waited 0.029s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f22d4a-108e-42d9-969d-8f3ec4a3c32e]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:35 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:36 devstack sudo[113955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd Jun 23 20:35:36 devstack sudo[113955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (6ebc692f-7337-48fe-9847-78b1fc53c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4907e6-6c19-490b-b61b-eb133f43446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4907e6-6c19-490b-b61b-eb133f43446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828169415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d6f05b-21b4-4ec0-b9d6-8965678fd4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:36Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5a153c-c596-4a2d-8ba0-75ce15337768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5a153c-c596-4a2d-8ba0-75ce15337768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eadc0faa-e127-4f84-8ab3-4cfce7aaaf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eadc0faa-e127-4f84-8ab3-4cfce7aaaf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d6f05b-21b4-4ec0-b9d6-8965678fd4b0', 'volume_name': 'volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27927c7e-5e18-4e6f-a675-c1cdf4e7e549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27927c7e-5e18-4e6f-a675-c1cdf4e7e549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615aa082-9757-4035-9a53-c63a11de896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume 31d6f05b-21b4-4ec0-b9d6-8965678fd4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0', 'volume_size': 1} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (9d7381dc-a2c1-4e18-9e50-0ba9ded002f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd62da94-6588-4abf-a627-0a8277f8f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd62da94-6588-4abf-a627-0a8277f8f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-549637941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4180c0-015d-4f4f-abba-403014992435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:36Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3c0bf4-4ad7-4912-902b-6f7da5f421f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3c0bf4-4ad7-4912-902b-6f7da5f421f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af18ca6c-907c-4848-9646-a55bf1a5c16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af18ca6c-907c-4848-9646-a55bf1a5c16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4180c0-015d-4f4f-abba-403014992435', 'volume_name': 'volume-9e4180c0-015d-4f4f-abba-403014992435', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784aafa4-4f44-42d3-90d8-a53c7bd66fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784aafa4-4f44-42d3-90d8-a53c7bd66fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5475c18-6a69-4e6a-b351-06eb384f4400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume 9e4180c0-015d-4f4f-abba-403014992435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4180c0-015d-4f4f-abba-403014992435', 'volume_size': 1} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:36 devstack sudo[113953]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (53ef5eea-e69c-49a1-8253-0754fa0e704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675d094b-c06b-4b1d-969e-522cf5443cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 1073741824" returned: 0 in 1.129s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675d094b-c06b-4b1d-969e-522cf5443cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023719764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3975922-9638-435f-94d0-55d0808a9a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:37Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b7b2a8-8da3-48d8-8ba5-72b71762892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b7b2a8-8da3-48d8-8ba5-72b71762892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c974d733-4c25-4c51-9d5c-35156176a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c974d733-4c25-4c51-9d5c-35156176a86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3975922-9638-435f-94d0-55d0808a9a5e', 'volume_name': 'volume-c3975922-9638-435f-94d0-55d0808a9a5e', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93a6af-541c-4a84-b694-4dbd02177d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:36 devstack sudo[113955]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:36 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93a6af-541c-4a84-b694-4dbd02177d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eef98b1-0789-4dff-bcf3-525640685c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume c3975922-9638-435f-94d0-55d0808a9a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3975922-9638-435f-94d0-55d0808a9a5e', 'volume_size': 1} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" returned: 0 in 1.035s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:37 devstack sudo[113963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd Jun 23 20:35:37 devstack sudo[113963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:37 devstack sudo[113965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 Jun 23 20:35:37 devstack sudo[113965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93739) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (c0bb231f-d2ec-4675-aadf-afb227841b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49ee49d-877d-400f-8193-1bc632b46e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49ee49d-877d-400f-8193-1bc632b46e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-187153851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a27812-6473-4da6-946f-c3672f0cc9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:37Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f0227c-304e-435c-b360-1375877b27a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f0227c-304e-435c-b360-1375877b27a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b189406-5d71-4bfb-89a1-bd4686af0f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b189406-5d71-4bfb-89a1-bd4686af0f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a27812-6473-4da6-946f-c3672f0cc9a4', 'volume_name': 'volume-51a27812-6473-4da6-946f-c3672f0cc9a4', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd0cf02-6e5c-46cc-b795-634e13fced6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd0cf02-6e5c-46cc-b795-634e13fced6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6e6159-833f-4fe3-81ab-40967388cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume 51a27812-6473-4da6-946f-c3672f0cc9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a27812-6473-4da6-946f-c3672f0cc9a4', 'volume_size': 1} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:37 devstack sudo[113963]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" returned: 0 in 0.707s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd" released by "delete_volume" :: held 1.803s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:37 devstack sudo[113965]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8" returned: 0 in 0.731s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828169415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d6f05b-21b4-4ec0-b9d6-8965678fd4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:36Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Creating volume 31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:37 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Created reservations ['0af07ccb-2a30-42d0-90dd-b873018235bd', '67092fd3-6758-4520-b214-f26de552308a', '986d1ba3-dece-4ad4-ab75-84910cb3337f', '3578ad50-ed88-4cbd-973e-1dab0807b7f4'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:37 devstack sudo[113969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 1073741824 Jun 23 20:35:37 devstack sudo[113969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89181e06-98d3-40ba-ad51-4ecd1353df84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd564547-415c-44d5-ade2-80cc5920da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:37 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 (a7ca870e-dc82-438f-bf13-7dd058c7c8a8): created successfully Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd564547-415c-44d5-ade2-80cc5920da6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (6c638b18-8537-4404-adbe-18931d2f4a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:37 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-a470ed00-34da-4ac3-82c1-46d42e837b51 tempest-CreateVolumesFromSnapshotTest-776528514 None] Created volume successfully. Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:37 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:37 devstack sudo[113971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:37 devstack sudo[113971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-09477479-2f4f-483d-a3a1-9f42714cf741-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-09477479-2f4f-483d-a3a1-9f42714cf741-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "cinder-quobyte-09477479-2f4f-483d-a3a1-9f42714cf741" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-09477479-2f4f-483d-a3a1-9f42714cf741" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4f4358-721d-4eaa-91b2-1126f725e29d]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:38 devstack sudo[113973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 Jun 23 20:35:38 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:38 devstack sudo[113971]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.734s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:38 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Deleted volume successfully. Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-8291085e-4792-40a5-a734-ad8f144297ef tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-1b3ab5c8-f2fb-416c-bb0e-d039f05ab3fd-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:38 devstack sudo[113969]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 1073741824" returned: 0 in 0.954s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:38 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:38 devstack sudo[113982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 Jun 23 20:35:38 devstack sudo[113982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:39 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741" returned: 0 in 0.844s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:39 devstack sudo[113987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741 Jun 23 20:35:39 devstack sudo[113987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:39 devstack sudo[113982]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0" returned: 0 in 0.681s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.844s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-549637941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4180c0-015d-4f4f-abba-403014992435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:36Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Creating volume 9e4180c0-015d-4f4f-abba-403014992435 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:39 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615aa082-9757-4035-9a53-c63a11de896d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:39 devstack sudo[113990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 1073741824 Jun 23 20:35:39 devstack sudo[113990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4048705c-19be-4c93-b6e5-9f9effac4acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:39 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 (31d6f05b-21b4-4ec0-b9d6-8965678fd4b0): created successfully Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4048705c-19be-4c93-b6e5-9f9effac4acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (6ebc692f-7337-48fe-9847-78b1fc53c957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:39 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-83b76d62-e39e-4169-b869-f9e313739816 tempest-CreateVolumesFromSnapshotTest-776528514 None] Created volume successfully. Jun 23 20:35:39 devstack sudo[113987]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-09477479-2f4f-483d-a3a1-9f42714cf741" returned: 0 in 0.702s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-quobyte-09477479-2f4f-483d-a3a1-9f42714cf741" released by "delete_volume" :: held 1.591s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Created reservations ['99343a70-9884-45bb-a4ea-f0cd68063859', 'a3949c3f-c7ef-4b48-a9c7-bedc2b76fe90', '8458935c-eeeb-49e9-a7fd-4e112bc85c2c', 'dd48e808-e498-405e-b8c7-087a2bc5fd22'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:39 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:39 devstack sudo[113993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:39 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:40 devstack sudo[113990]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 1073741824" returned: 0 in 0.816s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:40 devstack sudo[113998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 Jun 23 20:35:40 devstack sudo[113998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:40 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:40 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.726s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:40 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:40 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Deleted volume successfully. Jun 23 20:35:40 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-60dc6968-5278-42af-8a56-cf3a4cd31342 tempest-SnapshotDependencyTests-179661627 None] Lock "cinder-09477479-2f4f-483d-a3a1-9f42714cf741-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:41 devstack sudo[113998]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435" returned: 0 in 0.734s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.091s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023719764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3975922-9638-435f-94d0-55d0808a9a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:37Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Creating volume c3975922-9638-435f-94d0-55d0808a9a5e {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:41 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5475c18-6a69-4e6a-b351-06eb384f4400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4180c0-015d-4f4f-abba-403014992435', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:41 devstack sudo[114002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e 1073741824 Jun 23 20:35:41 devstack sudo[114002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5743cafd-79e6-4b99-8ace-a66427e39fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:41 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume volume-9e4180c0-015d-4f4f-abba-403014992435 (9e4180c0-015d-4f4f-abba-403014992435): created successfully Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5743cafd-79e6-4b99-8ace-a66427e39fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:41 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (9d7381dc-a2c1-4e18-9e50-0ba9ded002f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:41 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-f9152a68-a163-4458-9e19-968a76131bff tempest-CreateVolumesFromSnapshotTest-776528514 None] Created volume successfully. Jun 23 20:35:42 devstack sudo[114002]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e 1073741824" returned: 0 in 0.981s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:42 devstack sudo[114009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e Jun 23 20:35:42 devstack sudo[114009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:42 devstack sudo[114009]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e" returned: 0 in 0.696s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.445s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T18:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-187153851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a27812-6473-4da6-946f-c3672f0cc9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0409390876994303aa9f1c412f862bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T18:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T18:35:37Z,use_quota=True,user_id='b50c0e1ee43f428f866828fbb7f1eee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(095d74ec-9228-4d86-9704-b8652c0f9cbe),volume_type_id=095d74ec-9228-4d86-9704-b8652c0f9cbe)}" {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Creating volume 51a27812-6473-4da6-946f-c3672f0cc9a4 {{(pid=93739) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Selected osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 as target Quobyte volume. {{(pid=93739) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 20:35:42 devstack cinder-volume[93739]: INFO cinder.volume.drivers.remotefs [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] casted to osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9 Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 1073741824 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eef98b1-0789-4dff-bcf3-525640685c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3975922-9638-435f-94d0-55d0808a9a5e', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be926d5-b59d-46f1-b6c6-cc7aceee4fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:42 devstack sudo[114012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 1073741824 Jun 23 20:35:42 devstack sudo[114012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:42 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume volume-c3975922-9638-435f-94d0-55d0808a9a5e (c3975922-9638-435f-94d0-55d0808a9a5e): created successfully Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be926d5-b59d-46f1-b6c6-cc7aceee4fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:42 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (53ef5eea-e69c-49a1-8253-0754fa0e704d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:42 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-545e7683-3d6f-4d7e-bf80-4af6bfc20694 tempest-CreateVolumesFromSnapshotTest-776528514 None] Created volume successfully. Jun 23 20:35:43 devstack sudo[114012]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 1073741824" returned: 0 in 1.024s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:43 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:43 devstack sudo[114017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 Jun 23 20:35:43 devstack sudo[114017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:44 devstack sudo[114017]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4" returned: 0 in 0.752s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:44 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'} {{(pid=93739) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 20:35:44 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6e6159-833f-4fe3-81ab-40967388cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a27812-6473-4da6-946f-c3672f0cc9a4', 'volume_size': 1}' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a6e5ba-2b54-4c1b-9464-ea2c89e763bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 20:35:44 devstack cinder-volume[93739]: INFO cinder.volume.flows.manager.create_volume [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Volume volume-51a27812-6473-4da6-946f-c3672f0cc9a4 (51a27812-6473-4da6-946f-c3672f0cc9a4): created successfully Jun 23 20:35:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a6e5ba-2b54-4c1b-9464-ea2c89e763bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93739) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 20:35:44 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Flow 'volume_create_manager' (c0bb231f-d2ec-4675-aadf-afb227841b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93739) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 20:35:44 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-ef10ebec-6940-4003-a341-b363d7ee540a tempest-CreateVolumesFromSnapshotTest-776528514 None] Created volume successfully. Jun 23 20:35:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-51a27812-6473-4da6-946f-c3672f0cc9a4-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-51a27812-6473-4da6-946f-c3672f0cc9a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-quobyte-51a27812-6473-4da6-946f-c3672f0cc9a4" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:45 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-51a27812-6473-4da6-946f-c3672f0cc9a4" acquired by "delete_volume" :: waited 0.016s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:45 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[226d6916-3819-4213-bcdf-a0954f6281fe]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:45 devstack sudo[114022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 Jun 23 20:35:45 devstack sudo[114022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:45 devstack sudo[114022]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4" returned: 0 in 0.802s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:45 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:46 devstack sudo[114028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4 Jun 23 20:35:46 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:46 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-51a27812-6473-4da6-946f-c3672f0cc9a4" returned: 0 in 0.717s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-51a27812-6473-4da6-946f-c3672f0cc9a4" released by "delete_volume" :: held 1.570s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:46 devstack sudo[114031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:46 devstack sudo[114031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Created reservations ['dbf4edb0-6d0b-4d59-a248-03f258b30178', 'f09a6783-9854-4a24-93c9-aa2cea4f3abe', '4feaf7d9-a348-4f23-9f63-2cb5a753712d', '351ea05a-7191-4bf4-8dd2-47a45cf2670f'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:46 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:46 devstack sudo[114033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:46 devstack sudo[114033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-c3975922-9638-435f-94d0-55d0808a9a5e-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-c3975922-9638-435f-94d0-55d0808a9a5e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-quobyte-c3975922-9638-435f-94d0-55d0808a9a5e" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-c3975922-9638-435f-94d0-55d0808a9a5e" acquired by "delete_volume" :: waited 0.015s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f64ba-0bfe-4c75-ba26-2e4481ac8092]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:47 devstack sudo[114035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e Jun 23 20:35:47 devstack sudo[114035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:47 devstack sudo[114031]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.976s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG oslo_service.periodic_task [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] Running periodic task VolumeManager._thread_info {{(pid=93739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread count: 28 {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.volume.manager [None req-6f6f82f0-68f5-4f55-bdb3-04593d9d26e2 None None] thread info: [<_MainThread(MainThread, started 138734641275008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 20:35:47 devstack sudo[114033]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.843s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:47 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Deleted volume successfully. Jun 23 20:35:47 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-18b826e0-c3f4-479f-8d8d-71bd3db6ca23 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-51a27812-6473-4da6-946f-c3672f0cc9a4-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:48 devstack sudo[114035]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e" returned: 0 in 0.848s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:48 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:48 devstack sudo[114043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e Jun 23 20:35:48 devstack sudo[114043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:49 devstack sudo[114043]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-c3975922-9638-435f-94d0-55d0808a9a5e" returned: 0 in 0.706s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-c3975922-9638-435f-94d0-55d0808a9a5e" released by "delete_volume" :: held 1.613s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Created reservations ['b43a7e91-4bad-4d03-a7ad-bd229646ec1d', '76c061ee-24f9-4e68-92a7-5954236cc69e', '6ee4f367-9f3a-4b6d-8c41-dc21345b1469', '3645e275-12a3-4501-986f-cba4589e273b'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:49 devstack sudo[114046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:49 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-9e4180c0-015d-4f4f-abba-403014992435-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-9e4180c0-015d-4f4f-abba-403014992435-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-quobyte-9e4180c0-015d-4f4f-abba-403014992435" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-9e4180c0-015d-4f4f-abba-403014992435" acquired by "delete_volume" :: waited 0.019s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd548b6-e4f2-4655-b7c7-ada91d69ddd3]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:49 devstack sudo[114048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 Jun 23 20:35:49 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:49 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.689s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:49 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Deleted volume successfully. Jun 23 20:35:49 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-db5f094f-3903-4cef-9b7a-039f7f265fed tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-c3975922-9638-435f-94d0-55d0808a9a5e-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:50 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435" returned: 0 in 0.764s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:50 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:50 devstack sudo[114054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435 Jun 23 20:35:50 devstack sudo[114054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:51 devstack sudo[114054]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-9e4180c0-015d-4f4f-abba-403014992435" returned: 0 in 0.619s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-9e4180c0-015d-4f4f-abba-403014992435" released by "delete_volume" :: held 1.430s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Created reservations ['8b416b14-09b6-45c4-b3e7-b89e9a649ea7', '805aee17-514d-40e3-9ff0-04cb3d104f01', 'eeafd6d0-96e1-468f-8203-9d508a7bdfcb', 'b80eedf5-908a-4c4c-97d9-7ea64e4e27f3'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:51 devstack sudo[114060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:51 devstack sudo[114060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:51 devstack sudo[114060]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.626s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:51 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Deleted volume successfully. Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-c02f646d-4f2e-44df-998d-1df86bb0f59b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-9e4180c0-015d-4f4f-abba-403014992435-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-quobyte-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0" acquired by "delete_volume" :: waited 0.014s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb9ae2f-c863-42c7-850c-dc9287384082]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:51 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:52 devstack sudo[114066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 Jun 23 20:35:52 devstack sudo[114066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:52 devstack sudo[114066]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0" returned: 0 in 0.731s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:52 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:52 devstack sudo[114071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0 Jun 23 20:35:52 devstack sudo[114071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:53 devstack sudo[114071]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0" returned: 0 in 0.666s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0" released by "delete_volume" :: held 1.435s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Created reservations ['391954d2-4c33-4deb-8c77-0fbc345cbdaf', '70ce43e0-622f-4815-b2a9-e4dc6e527f81', '3e6c4796-bad1-40a7-bd16-0d7f6ece8209', 'c31e3b1b-8640-4ffc-b050-05228a42c5bd'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:53 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:53 devstack sudo[114074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:53 devstack sudo[114074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-a7ca870e-dc82-438f-bf13-7dd058c7c8a8-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-a7ca870e-dc82-438f-bf13-7dd058c7c8a8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:54 devstack sudo[114074]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.661s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:54 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Deleted volume successfully. Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-quobyte-a7ca870e-dc82-438f-bf13-7dd058c7c8a8" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-119cc374-82b9-47a3-99ac-1bc1ac640c8a tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-31d6f05b-21b4-4ec0-b9d6-8965678fd4b0-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-a7ca870e-dc82-438f-bf13-7dd058c7c8a8" acquired by "delete_volume" :: waited 0.014s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9361666-9113-4f42-b142-59a1db9bd6ac]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:54 devstack sudo[114077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 Jun 23 20:35:54 devstack sudo[114077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:54 devstack sudo[114077]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8" returned: 0 in 0.720s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:54 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:54 devstack sudo[114083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8 Jun 23 20:35:54 devstack sudo[114083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:55 devstack sudo[114083]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-a7ca870e-dc82-438f-bf13-7dd058c7c8a8" returned: 0 in 0.632s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-a7ca870e-dc82-438f-bf13-7dd058c7c8a8" released by "delete_volume" :: held 1.398s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Created reservations ['b13bbf63-4f85-48aa-b40b-47d9d348104f', '9dedd3f3-61d2-4327-84ef-f0e36efe59fc', '5ca98b33-4cc9-471e-a8d9-1aad7bbe7aff', '7c61ba2f-899b-4d7b-808f-c0085ad57071'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:35:55 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:55 devstack sudo[114086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:35:55 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:56 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-23c13b1d-0cfc-47cf-9a81-8cfeb58359db-delete_snapshot" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.644s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:35:56 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Deleted volume successfully. Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-23c13b1d-0cfc-47cf-9a81-8cfeb58359db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-quobyte-5af04a02-a3cc-4896-b2ad-b3462e5375b2" by "delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-5af04a02-a3cc-4896-b2ad-b3462e5375b2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-quobyte-23c13b1d-0cfc-47cf-9a81-8cfeb58359db" by "_delete_snapshot" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-fa4b5306-94e2-4ff3-9922-8b294600cef8 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-a7ca870e-dc82-438f-bf13-7dd058c7c8a8-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-23c13b1d-0cfc-47cf-9a81-8cfeb58359db" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Deleting offline snapshot 23c13b1d-0cfc-47cf-9a81-8cfeb58359db of volume 5af04a02-a3cc-4896-b2ad-b3462e5375b2 {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] snapshot_file for this snap is: volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db {{(pid=93739) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae8abe9-7071-4263-9578-3cd845422a15]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:56 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:56 devstack sudo[114089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db Jun 23 20:35:56 devstack sudo[114089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:57 devstack sudo[114089]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db" returned: 0 in 0.759s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:57 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.remotefs [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93739) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 20:35:57 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3b271-201e-4187-9905-ae448635d013]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:35:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:57 devstack sudo[114094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 Jun 23 20:35:57 devstack sudo[114094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:57 devstack sudo[114094]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2" returned: 0 in 0.772s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:57 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:58 devstack sudo[114099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db Jun 23 20:35:58 devstack sudo[114099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:58 devstack sudo[114099]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db" returned: 0 in 0.741s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:58 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:35:58 devstack sudo[114104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db Jun 23 20:35:58 devstack sudo[114104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:35:59 devstack sudo[114104]: pam_unix(sudo:session): session closed for user root Jun 23 20:35:59 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2.23c13b1d-0cfc-47cf-9a81-8cfeb58359db" returned: 0 in 0.619s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:35:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-23c13b1d-0cfc-47cf-9a81-8cfeb58359db" released by "_delete_snapshot" :: held 2.990s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-5af04a02-a3cc-4896-b2ad-b3462e5375b2" released by "delete_snapshot" :: held 3.014s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:35:59 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Created reservations ['bc5df020-2ec9-424c-884b-467aaec06a53', '699e28a3-bef4-4c60-8739-b12ca998ae8b', '7387b69b-2d28-45c7-a736-ffe99c7abfa1', 'bd798592-dcb6-491e-9b46-3950b86daed8'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:35:59 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Delete snapshot completed successfully. Jun 23 20:35:59 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-dbfdc533-2d44-40fd-b2df-0c2862547543 tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-23c13b1d-0cfc-47cf-9a81-8cfeb58359db-delete_snapshot" released by "delete_snapshot" :: held 3.158s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:36:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-5af04a02-a3cc-4896-b2ad-b3462e5375b2-delete_volume" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:36:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-5af04a02-a3cc-4896-b2ad-b3462e5375b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:36:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "cinder-quobyte-5af04a02-a3cc-4896-b2ad-b3462e5375b2" by "delete_volume" {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 20:36:00 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-5af04a02-a3cc-4896-b2ad-b3462e5375b2" acquired by "delete_volume" :: waited 0.013s {{(pid=93739) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 20:36:00 devstack cinder-volume[93739]: DEBUG oslo.privsep.daemon [-] privsep: reply[229d4f2d-d2e4-416e-977b-48d05fea4245]: (4, 'qcow2') {{(pid=95007) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 20:36:00 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:36:00 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 Jun 23 20:36:00 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:36:01 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Jun 23 20:36:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2" returned: 0 in 0.742s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:36:01 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:36:01 devstack sudo[114112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2 Jun 23 20:36:01 devstack sudo[114112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:36:02 devstack sudo[114112]: pam_unix(sudo:session): session closed for user root Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153/volume-5af04a02-a3cc-4896-b2ad-b3462e5375b2" returned: 0 in 0.628s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-quobyte-5af04a02-a3cc-4896-b2ad-b3462e5375b2" released by "delete_volume" :: held 1.426s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG cinder.quota [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Created reservations ['12a78d6d-3f41-4367-a552-dc159d43f213', 'a0b86f63-9dcf-461c-9fab-18b36c1f4fb6', '2c70b16e-7933-45ea-bf72-6ff89ee713ad', 'b4f4874a-9bcc-468e-b415-98039062f347'] {{(pid=93739) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9': None} {{(pid=93739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG cinder.volume.drivers.quobyte [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a287b18-dac6-4066-aa4a-546db96a66c9'] {{(pid=93739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.lockutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93739) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 20:36:02 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153 Jun 23 20:36:02 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 20:36:02 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG oslo_concurrency.processutils [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b62f14256912bab4aea26189286b7153" returned: 0 in 0.665s {{(pid=93739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG cinder.manager [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Notifying Schedulers of capabilities ... {{(pid=93739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 20:36:02 devstack cinder-volume[93739]: INFO cinder.volume.manager [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Deleted volume successfully. Jun 23 20:36:02 devstack cinder-volume[93739]: DEBUG cinder.coordination [None req-7467d4a4-43f7-40ec-80a2-22de99ea843b tempest-CreateVolumesFromSnapshotTest-776528514 None] Lock "cinder-5af04a02-a3cc-4896-b2ad-b3462e5375b2-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=93739) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 20:36:12 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:UPDATE=167,cinder:SELECT=104,cinder:INSERT=41,cinder:DELETE=14 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 20:36:12 devstack cinder-volume[93739]: DEBUG dbcounter [-] [93739] Writing DB stats cinder:SELECT=128,cinder:INSERT=41,cinder:UPDATE=163,cinder:DELETE=12 {{(pid=93739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}